2026-03-29 10:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 10:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 10:30:06 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-29 10:30:06 [auto1.de] INFO: Starting spider auto1.de
2026-03-29 10:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 10:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 10:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 10:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 10:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: b7aa4ce0a65e9de5
2026-03-29 10:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 10:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-29T10_30_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 10:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 10:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 10:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 10:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 10:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 10:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 10:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 10:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-29 10:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 10:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 10:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 10:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 10:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 10:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 10:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 10:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 10:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 10:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 10:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 10:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-29 10:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 10:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 10:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 10:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 10:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 10:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 10:30:44 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 6726 | hits on page: 40
2026-03-29 10:30:44 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-29 10:30:44 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-29 10:30:44 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-29 10:30:44 [auto1.de] INFO: Scrape type for SA16616: 2
2026-03-29 10:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eddad159-d1a9-5919-bd96-6eecff54c4af with identifier: SA16616
2026-03-29 10:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eddad159-d1a9-5919-bd96-6eecff54c4af with scrape type 2
2026-03-29 10:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eddad159-d1a9-5919-bd96-6eecff54c4af with scrape type 2
2026-03-29 10:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eddad159-d1a9-5919-bd96-6eecff54c4af, identifier: SA16616
2026-03-29 10:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eddad159-d1a9-5919-bd96-6eecff54c4af with identifier: SA16616
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 10:30:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 10:30:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eddad159-d1a9-5919-bd96-6eecff54c4af with identifier: SA16616
2026-03-29 10:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eddad159-d1a9-5919-bd96-6eecff54c4af with identifier: SA16616 to the API
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:38:17Z',
'fuel_type': 'petrol',
'id': 'eddad159-d1a9-5919-bd96-6eecff54c4af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA16616',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 187628,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-19',
'seller_name': None,
'title': 'Mazda 3 1.6 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2006}
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-29 10:30:44 [auto1.de] INFO: Saving data for SA16616: {'auction_closing_time': 1774885097.0, 'created_time': 1773467266.313422, 'last_price_update_time': 1774780244.94743}
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA16616') HTTP/1.1" 204 0
2026-03-29 10:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:44 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-29 10:30:44 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-29 10:30:44 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-29 10:30:44 [auto1.de] INFO: Scrape type for HN36676: 2
2026-03-29 10:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27a0d7b0-4392-5c97-868b-18d02001ac77 with identifier: HN36676
2026-03-29 10:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27a0d7b0-4392-5c97-868b-18d02001ac77 with scrape type 2
2026-03-29 10:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27a0d7b0-4392-5c97-868b-18d02001ac77 with scrape type 2
2026-03-29 10:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27a0d7b0-4392-5c97-868b-18d02001ac77, identifier: HN36676
2026-03-29 10:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27a0d7b0-4392-5c97-868b-18d02001ac77 with identifier: HN36676
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 10:30:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27a0d7b0-4392-5c97-868b-18d02001ac77 with identifier: HN36676
2026-03-29 10:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27a0d7b0-4392-5c97-868b-18d02001ac77 with identifier: HN36676 to the API
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 203,
'expiration_date': '2026-03-30T15:09:59Z',
'fuel_type': 'petrol',
'id': '27a0d7b0-4392-5c97-868b-18d02001ac77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN36676',
'listing': 'auction',
'make': 'Chrysler',
'model': 'Sebring',
'odometer': 174517,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-12-04',
'seller_name': None,
'title': 'Chrysler Sebring 2.7 Limited',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2002}
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-29 10:30:45 [auto1.de] INFO: Saving data for HN36676: {'auction_closing_time': 1774883399.0, 'created_time': 1774550474.514363, 'last_price_update_time': 1774780245.630492}
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN36676') HTTP/1.1" 204 0
2026-03-29 10:30:45 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-29 10:30:45 [auto1.de] INFO: Scrape type for BX89684: 2
2026-03-29 10:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with identifier: BX89684
2026-03-29 10:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with scrape type 2
2026-03-29 10:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with scrape type 2
2026-03-29 10:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a, identifier: BX89684
2026-03-29 10:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with identifier: BX89684
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 10:30:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with identifier: BX89684
2026-03-29 10:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cf1e8d8-4956-52d3-8c36-e9dc3a96456a with identifier: BX89684 to the API
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:03:38Z',
'fuel_type': 'petrol',
'id': '6cf1e8d8-4956-52d3-8c36-e9dc3a96456a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX89684',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 155945,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-27',
'seller_name': None,
'title': 'Opel Meriva 1.6 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2006}
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-29 10:30:46 [auto1.de] INFO: Saving data for BX89684: {'auction_closing_time': 1774883018.0, 'created_time': 1773946208.620454, 'last_price_update_time': 1774780246.384257}
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX89684') HTTP/1.1" 204 0
2026-03-29 10:30:46 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-29 10:30:46 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-29 10:30:46 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-29 10:30:46 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-29 10:30:46 [auto1.de] INFO: Scrape type for HM22337: 1
2026-03-29 10:30:46 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-29 10:30:46 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-29 10:30:46 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-29 10:30:46 [auto1.de] INFO: Scrape type for MP03054: 2
2026-03-29 10:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 174bb4a7-d776-5517-8bb0-4198b3aac9fb with identifier: MP03054
2026-03-29 10:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 174bb4a7-d776-5517-8bb0-4198b3aac9fb with scrape type 2
2026-03-29 10:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 174bb4a7-d776-5517-8bb0-4198b3aac9fb with scrape type 2
2026-03-29 10:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 174bb4a7-d776-5517-8bb0-4198b3aac9fb, identifier: MP03054
2026-03-29 10:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 174bb4a7-d776-5517-8bb0-4198b3aac9fb with identifier: MP03054
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 10:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 10:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 174bb4a7-d776-5517-8bb0-4198b3aac9fb with identifier: MP03054
2026-03-29 10:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 174bb4a7-d776-5517-8bb0-4198b3aac9fb with identifier: MP03054 to the API
2026-03-29 10:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:14:21Z',
'fuel_type': 'diesel',
'id': '174bb4a7-d776-5517-8bb0-4198b3aac9fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP03054',
'listing': 'auction',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 213582,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-14',
'seller_name': None,
'title': 'Toyota Avensis 2.0 D-4D Travel',
'transmission': 'manual',
'trim': 'Travel',
'year': 2007}
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-29 10:30:47 [auto1.de] INFO: Saving data for MP03054: {'auction_closing_time': 1774883661.0, 'created_time': 1774550592.443565, 'last_price_update_time': 1774780247.156006}
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP03054') HTTP/1.1" 204 0
2026-03-29 10:30:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:47 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-29 10:30:47 [auto1.de] INFO: Scrape type for PF20752: 2
2026-03-29 10:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with identifier: PF20752
2026-03-29 10:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with scrape type 2
2026-03-29 10:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with scrape type 2
2026-03-29 10:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da, identifier: PF20752
2026-03-29 10:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with identifier: PF20752
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 10:30:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with identifier: PF20752
2026-03-29 10:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9eb0f89a-3b8c-547a-8c83-7d8d8486c4da with identifier: PF20752 to the API
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:37:05Z',
'fuel_type': 'petrol',
'id': '9eb0f89a-3b8c-547a-8c83-7d8d8486c4da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF20752',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 166341,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-12',
'seller_name': None,
'title': 'Ford Ka 1.2 Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2010}
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-29 10:30:47 [auto1.de] INFO: Saving data for PF20752: {'auction_closing_time': 1774885025.0, 'created_time': 1773819042.811559, 'last_price_update_time': 1774780247.880738}
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF20752') HTTP/1.1" 204 0
2026-03-29 10:30:47 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-29 10:30:47 [auto1.de] INFO: Scrape type for JM25076: 1
2026-03-29 10:30:47 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-29 10:30:47 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-29 10:30:47 [auto1.de] INFO: Scrape type for HD80802: 2
2026-03-29 10:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with identifier: HD80802
2026-03-29 10:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with scrape type 2
2026-03-29 10:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with scrape type 2
2026-03-29 10:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25, identifier: HD80802
2026-03-29 10:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with identifier: HD80802
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 10:30:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with identifier: HD80802
2026-03-29 10:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8965acc5-c4f9-542d-95f5-c19e2aa7bf25 with identifier: HD80802 to the API
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:12:13Z',
'fuel_type': 'petrol',
'id': '8965acc5-c4f9-542d-95f5-c19e2aa7bf25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD80802',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 103357,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-28',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2015}
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-29 10:30:48 [auto1.de] INFO: Saving data for HD80802: {'auction_closing_time': 1774883533.0, 'created_time': 1774636936.447051, 'last_price_update_time': 1774780248.495913}
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD80802') HTTP/1.1" 204 0
2026-03-29 10:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:48 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-29 10:30:48 [auto1.de] INFO: Scrape type for CR70620: 2
2026-03-29 10:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3064c95f-23c0-5049-97d5-c53a75d03869 with identifier: CR70620
2026-03-29 10:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3064c95f-23c0-5049-97d5-c53a75d03869 with scrape type 2
2026-03-29 10:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3064c95f-23c0-5049-97d5-c53a75d03869 with scrape type 2
2026-03-29 10:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3064c95f-23c0-5049-97d5-c53a75d03869, identifier: CR70620
2026-03-29 10:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3064c95f-23c0-5049-97d5-c53a75d03869 with identifier: CR70620
2026-03-29 10:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3064c95f-23c0-5049-97d5-c53a75d03869 with identifier: CR70620
2026-03-29 10:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3064c95f-23c0-5049-97d5-c53a75d03869 with identifier: CR70620 to the API
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:21:15Z',
'fuel_type': 'petrol',
'id': '3064c95f-23c0-5049-97d5-c53a75d03869',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR70620',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 260555,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-09-13',
'seller_name': None,
'title': 'Audi A4 2.0',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-29 10:30:48 [auto1.de] INFO: Saving data for CR70620: {'auction_closing_time': 1774884075.0, 'created_time': 1773138916.136949, 'last_price_update_time': 1774780248.96417}
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR70620') HTTP/1.1" 204 0
2026-03-29 10:30:48 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-29 10:30:48 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-29 10:30:48 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX43483%27 HTTP/1.1" 200 None
2026-03-29 10:30:49 [auto1.de] INFO: Scrape type for PX43483: 1
2026-03-29 10:30:49 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-29 10:30:49 [auto1.de] INFO: Scrape type for FY87536: 2
2026-03-29 10:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-29 10:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e35780-76f8-5445-adec-7dae87def37a with scrape type 2
2026-03-29 10:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e35780-76f8-5445-adec-7dae87def37a with scrape type 2
2026-03-29 10:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33e35780-76f8-5445-adec-7dae87def37a, identifier: FY87536
2026-03-29 10:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-29 10:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536
2026-03-29 10:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33e35780-76f8-5445-adec-7dae87def37a with identifier: FY87536 to the API
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:59:52Z',
'fuel_type': 'diesel',
'id': '33e35780-76f8-5445-adec-7dae87def37a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY87536',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 145756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-19',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2018}
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-29 10:30:49 [auto1.de] INFO: Saving data for FY87536: {'auction_closing_time': 1774886392.0, 'created_time': 1774551177.68908, 'last_price_update_time': 1774780249.439265}
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY87536') HTTP/1.1" 204 0
2026-03-29 10:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:49 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-29 10:30:49 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-29 10:30:49 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-29 10:30:49 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS38701%27 HTTP/1.1" 200 None
2026-03-29 10:30:49 [auto1.de] INFO: Scrape type for KS38701: 1
2026-03-29 10:30:49 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-29 10:30:49 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-29 10:30:49 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-29 10:30:49 [auto1.de] INFO: Scrape type for LN64409: 2
2026-03-29 10:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with identifier: LN64409
2026-03-29 10:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with scrape type 2
2026-03-29 10:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with scrape type 2
2026-03-29 10:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd, identifier: LN64409
2026-03-29 10:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with identifier: LN64409
2026-03-29 10:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with identifier: LN64409
2026-03-29 10:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd with identifier: LN64409 to the API
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:40:21Z',
'fuel_type': 'diesel',
'id': 'f5a3e5d5-8c8b-59ea-a3c4-86582f7898bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN64409',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 115630,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-29',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2017}
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-29 10:30:49 [auto1.de] INFO: Saving data for LN64409: {'auction_closing_time': 1774885221.0, 'created_time': 1774550569.058108, 'last_price_update_time': 1774780249.931953}
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN64409') HTTP/1.1" 204 0
2026-03-29 10:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:50 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 6726 | hits on page: 40
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24074%27 HTTP/1.1" 200 None
2026-03-29 10:30:50 [auto1.de] INFO: Scrape type for UG24074: 2
2026-03-29 10:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 906729cf-654a-51d2-93e0-daf61bef56d9 with identifier: UG24074
2026-03-29 10:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 906729cf-654a-51d2-93e0-daf61bef56d9 with scrape type 2
2026-03-29 10:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 906729cf-654a-51d2-93e0-daf61bef56d9 with scrape type 2
2026-03-29 10:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 906729cf-654a-51d2-93e0-daf61bef56d9, identifier: UG24074
2026-03-29 10:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 906729cf-654a-51d2-93e0-daf61bef56d9 with identifier: UG24074
2026-03-29 10:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 906729cf-654a-51d2-93e0-daf61bef56d9 with identifier: UG24074
2026-03-29 10:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 906729cf-654a-51d2-93e0-daf61bef56d9 with identifier: UG24074 to the API
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:38:27Z',
'fuel_type': 'petrol',
'id': '906729cf-654a-51d2-93e0-daf61bef56d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG24074',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 133966,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-11-27',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2003}
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24074%27 HTTP/1.1" 200 None
2026-03-29 10:30:50 [auto1.de] INFO: Saving data for UG24074: {'auction_closing_time': 1774885107.0, 'created_time': 1773468612.4118, 'last_price_update_time': 1774780250.522579}
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG24074') HTTP/1.1" 204 0
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-29 10:30:50 [auto1.de] INFO: Scrape type for SA16616: 0
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-29 10:30:50 [auto1.de] INFO: Scrape type for HN36676: 0
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-29 10:30:50 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-29 10:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:50 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-29 10:30:50 [auto1.de] INFO: Scrape type for RE36292: 2
2026-03-29 10:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5ab2777-d4b8-514f-bcb1-62728189980d with identifier: RE36292
2026-03-29 10:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5ab2777-d4b8-514f-bcb1-62728189980d with scrape type 2
2026-03-29 10:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5ab2777-d4b8-514f-bcb1-62728189980d with scrape type 2
2026-03-29 10:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5ab2777-d4b8-514f-bcb1-62728189980d, identifier: RE36292
2026-03-29 10:30:50 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/HM22337/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-29 10:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5ab2777-d4b8-514f-bcb1-62728189980d with identifier: RE36292
2026-03-29 10:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5ab2777-d4b8-514f-bcb1-62728189980d with identifier: RE36292
2026-03-29 10:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5ab2777-d4b8-514f-bcb1-62728189980d with identifier: RE36292 to the API
2026-03-29 10:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 232,
'expiration_date': '2026-03-30T15:17:24Z',
'fuel_type': 'diesel',
'id': 'e5ab2777-d4b8-514f-bcb1-62728189980d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE36292',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 241115,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-03-02',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2006}
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-29 10:30:51 [auto1.de] INFO: Saving data for RE36292: {'auction_closing_time': 1774883844.0, 'created_time': 1773467412.16631, 'last_price_update_time': 1774780251.177874}
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE36292') HTTP/1.1" 204 0
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-29 10:30:51 [auto1.de] INFO: Scrape type for MP03054: 0
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-29 10:30:51 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-29 10:30:51 [auto1.de] INFO: Scrape type for ZA01516: 2
2026-03-29 10:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with identifier: ZA01516
2026-03-29 10:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with scrape type 2
2026-03-29 10:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with scrape type 2
2026-03-29 10:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f219faf7-5c71-5a8e-8d18-aeb43b4a3141, identifier: ZA01516
2026-03-29 10:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM25076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with identifier: ZA01516
2026-03-29 10:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with identifier: ZA01516
2026-03-29 10:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f219faf7-5c71-5a8e-8d18-aeb43b4a3141 with identifier: ZA01516 to the API
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'petrol',
'id': 'f219faf7-5c71-5a8e-8d18-aeb43b4a3141',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA01516',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Santa Fe',
'odometer': 219234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-06-21',
'seller_name': None,
'title': 'Hyundai Santa Fe 2.4 GLS',
'transmission': 'manual',
'trim': 'GLS',
'year': 2004}
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-29 10:30:51 [auto1.de] INFO: Saving data for ZA01516: {'auction_closing_time': 1774884844.0, 'created_time': 1773384332.763705, 'last_price_update_time': 1774780251.825751}
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA01516') HTTP/1.1" 204 0
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-29 10:30:51 [auto1.de] INFO: Scrape type for HD80802: 0
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-29 10:30:51 [auto1.de] INFO: Scrape type for CR70620: 0
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-29 10:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM22337/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-29 10:30:51 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-29 10:30:51 [auto1.de] INFO: Scrape type for NX65869: 2
2026-03-29 10:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d8827a7-57cb-5090-86dc-403fb6360a31 with identifier: NX65869
2026-03-29 10:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d8827a7-57cb-5090-86dc-403fb6360a31 with scrape type 2
2026-03-29 10:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d8827a7-57cb-5090-86dc-403fb6360a31 with scrape type 2
2026-03-29 10:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d8827a7-57cb-5090-86dc-403fb6360a31, identifier: NX65869
2026-03-29 10:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d8827a7-57cb-5090-86dc-403fb6360a31 with identifier: NX65869
2026-03-29 10:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d8827a7-57cb-5090-86dc-403fb6360a31 with identifier: NX65869
2026-03-29 10:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d8827a7-57cb-5090-86dc-403fb6360a31 with identifier: NX65869 to the API
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:40:23Z',
'fuel_type': 'petrol',
'id': '5d8827a7-57cb-5090-86dc-403fb6360a31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX65869',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Bora',
'odometer': 177352,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-02-24',
'seller_name': None,
'title': 'Volkswagen Bora 2.0 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2000}
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-29 10:30:52 [auto1.de] INFO: Saving data for NX65869: {'auction_closing_time': 1774885223.0, 'created_time': 1773657476.384113, 'last_price_update_time': 1774780252.413758}
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX65869') HTTP/1.1" 204 0
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-29 10:30:52 [auto1.de] INFO: Scrape type for FY87536: 0
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-29 10:30:52 [auto1.de] INFO: Scrape type for LN64409: 0
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24074%27 HTTP/1.1" 200 None
2026-03-29 10:30:52 [auto1.de] INFO: Scrape type for UG24074: 0
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-29 10:30:52 [auto1.de] INFO: Scrape type for RE36292: 0
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-29 10:30:52 [auto1.de] INFO: Scrape type for ZA01516: 0
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-29 10:30:52 [auto1.de] INFO: Scrape type for NX65869: 0
2026-03-29 10:30:52 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-29 10:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS38701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:30:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM25076> (referer: https://www.auto1.com/v1/car-details-view/JM25076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786528db-670c-5175-ab21-60d62ae69c69 with identifier: JM25076
2026-03-29 10:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786528db-670c-5175-ab21-60d62ae69c69 with scrape type 1
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 786528db-670c-5175-ab21-60d62ae69c69
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_dd41d3d34ed44d9424694646423fc499.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_dd41d3d34ed44d9424694646423fc499.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_8321c9dcd11dcd9bd2945fab8a653209.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_8321c9dcd11dcd9bd2945fab8a653209.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_7d4d373ff3299e63d222a64e25ec2d4f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_7d4d373ff3299e63d222a64e25ec2d4f.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_d7ac3f97588019f1139193437f4ce016.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_d7ac3f97588019f1139193437f4ce016.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_9ae61f1e1c9ccc28ad6de467cb47aa0b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_9ae61f1e1c9ccc28ad6de467cb47aa0b.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_5e94b7fb1257f7fd8d38f894a521a1c6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_5e94b7fb1257f7fd8d38f894a521a1c6.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_68b99505a8b4e730ebf345b084bf3d1d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_68b99505a8b4e730ebf345b084bf3d1d.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_9208680992db341717d4a3a721fc5f46.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_9208680992db341717d4a3a721fc5f46.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_3a5d8db03522eab5a43e059ede075f81.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_3a5d8db03522eab5a43e059ede075f81.jpg already downloaded
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F83%252Ff683f71ed33ce9bdcaf054504b1790d7%252Fpa%252FJM25076_06f0bf12798f41afc426d21a11646581.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_06f0bf12798f41afc426d21a11646581.jpg already downloaded
2026-03-29 10:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 786528db-670c-5175-ab21-60d62ae69c69, identifier: JM25076
2026-03-29 10:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 786528db-670c-5175-ab21-60d62ae69c69 with identifier: JM25076
2026-03-29 10:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 786528db-670c-5175-ab21-60d62ae69c69 with identifier: JM25076
2026-03-29 10:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 786528db-670c-5175-ab21-60d62ae69c69 with identifier: JM25076 to the API
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM25076>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:19:48Z',
'fuel_type': 'petrol',
'id': '786528db-670c-5175-ab21-60d62ae69c69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM25076',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 80868,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_dd41d3d34ed44d9424694646423fc499.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_8321c9dcd11dcd9bd2945fab8a653209.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_7d4d373ff3299e63d222a64e25ec2d4f.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_d7ac3f97588019f1139193437f4ce016.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_9ae61f1e1c9ccc28ad6de467cb47aa0b.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_5e94b7fb1257f7fd8d38f894a521a1c6.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_68b99505a8b4e730ebf345b084bf3d1d.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_9208680992db341717d4a3a721fc5f46.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_3a5d8db03522eab5a43e059ede075f81.jpg',
'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_06f0bf12798f41afc426d21a11646581.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_dd41d3d34ed44d9424694646423fc499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_8321c9dcd11dcd9bd2945fab8a653209.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_7d4d373ff3299e63d222a64e25ec2d4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_d7ac3f97588019f1139193437f4ce016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_9ae61f1e1c9ccc28ad6de467cb47aa0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_5e94b7fb1257f7fd8d38f894a521a1c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_68b99505a8b4e730ebf345b084bf3d1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_9208680992db341717d4a3a721fc5f46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_3a5d8db03522eab5a43e059ede075f81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_786528db-670c-5175-ab21-60d62ae69c69/786528db-670c-5175-ab21-60d62ae69c69_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/83/f683f71ed33ce9bdcaf054504b1790d7/pa/JM25076_06f0bf12798f41afc426d21a11646581.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-17',
'seats_number': 5,
'seller_name': None,
'title': "Kia pro_cee'd 1.6 TGDI GT",
'transmission': 'automatic',
'trim': 'GT',
'year': 2021}
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-29 10:30:55 [auto1.de] INFO: Saving data for JM25076: {'created_time': 1774780255.713329, 'last_price_update_time': 1774780255.713346, 'auction_closing_time': 1774883988.0}
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM25076') HTTP/1.1" 204 0
2026-03-29 10:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX43483/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:30:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:06 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 10 pages/min), scraped 14 items (at 14 items/min)
2026-03-29 10:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-29 10:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:10 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 6726 | hits on page: 40
2026-03-29 10:31:10 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-29 10:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69588%27 HTTP/1.1" 200 None
2026-03-29 10:31:10 [auto1.de] INFO: Scrape type for EM69588: 2
2026-03-29 10:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31db30a8-be10-5ca3-9f4e-26199e8473dc with identifier: EM69588
2026-03-29 10:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31db30a8-be10-5ca3-9f4e-26199e8473dc with scrape type 2
2026-03-29 10:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31db30a8-be10-5ca3-9f4e-26199e8473dc with scrape type 2
2026-03-29 10:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31db30a8-be10-5ca3-9f4e-26199e8473dc, identifier: EM69588
2026-03-29 10:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31db30a8-be10-5ca3-9f4e-26199e8473dc with identifier: EM69588
2026-03-29 10:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31db30a8-be10-5ca3-9f4e-26199e8473dc with identifier: EM69588
2026-03-29 10:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31db30a8-be10-5ca3-9f4e-26199e8473dc with identifier: EM69588 to the API
2026-03-29 10:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:54:29Z',
'fuel_type': 'petrol',
'id': '31db30a8-be10-5ca3-9f4e-26199e8473dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM69588',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Fox',
'odometer': 160238,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-11',
'seller_name': None,
'title': 'Volkswagen Fox 1.2',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 10:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69588%27 HTTP/1.1" 200 None
2026-03-29 10:31:12 [auto1.de] INFO: Saving data for EM69588: {'auction_closing_time': 1774886069.0, 'created_time': 1773484509.804162, 'last_price_update_time': 1774780272.978864}
2026-03-29 10:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM69588') HTTP/1.1" 204 0
2026-03-29 10:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:12 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-29 10:31:12 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-29 10:31:12 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA38840%27 HTTP/1.1" 200 None
2026-03-29 10:31:13 [auto1.de] INFO: Scrape type for RA38840: 2
2026-03-29 10:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with identifier: RA38840
2026-03-29 10:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with scrape type 2
2026-03-29 10:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with scrape type 2
2026-03-29 10:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27, identifier: RA38840
2026-03-29 10:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with identifier: RA38840
2026-03-29 10:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with identifier: RA38840
2026-03-29 10:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c63fa6d-0b08-5761-93dc-5a2e10b15a27 with identifier: RA38840 to the API
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 50,
'expiration_date': '2026-03-30T15:49:36Z',
'fuel_type': 'petrol',
'id': '8c63fa6d-0b08-5761-93dc-5a2e10b15a27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA38840',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 124875,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1997-02-06',
'seller_name': None,
'title': 'Volkswagen Polo 1.0',
'transmission': 'manual',
'trim': '',
'year': 1997}
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA38840%27 HTTP/1.1" 200 None
2026-03-29 10:31:13 [auto1.de] INFO: Saving data for RA38840: {'auction_closing_time': 1774885776.0, 'created_time': 1773467503.566884, 'last_price_update_time': 1774780273.432554}
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA38840') HTTP/1.1" 204 0
2026-03-29 10:31:13 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-29 10:31:13 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-29 10:31:13 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-29 10:31:13 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-29 10:31:13 [auto1.de] INFO: Scrape type for ES51146: 2
2026-03-29 10:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f843921-8ecd-5515-89ad-a5a557d6ac29 with identifier: ES51146
2026-03-29 10:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f843921-8ecd-5515-89ad-a5a557d6ac29 with scrape type 2
2026-03-29 10:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f843921-8ecd-5515-89ad-a5a557d6ac29 with scrape type 2
2026-03-29 10:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f843921-8ecd-5515-89ad-a5a557d6ac29, identifier: ES51146
2026-03-29 10:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f843921-8ecd-5515-89ad-a5a557d6ac29 with identifier: ES51146
2026-03-29 10:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f843921-8ecd-5515-89ad-a5a557d6ac29 with identifier: ES51146
2026-03-29 10:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f843921-8ecd-5515-89ad-a5a557d6ac29 with identifier: ES51146 to the API
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:44:30Z',
'fuel_type': 'petrol',
'id': '4f843921-8ecd-5515-89ad-a5a557d6ac29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES51146',
'listing': 'auction',
'make': 'Audi',
'model': '80',
'odometer': 253065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1993-02-28',
'seller_name': None,
'title': 'Audi 80 2.0',
'transmission': 'manual',
'trim': '',
'year': 1993}
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-29 10:31:13 [auto1.de] INFO: Saving data for ES51146: {'auction_closing_time': 1774885470.0, 'created_time': 1773301181.714873, 'last_price_update_time': 1774780273.898999}
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES51146') HTTP/1.1" 204 0
2026-03-29 10:31:13 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-29 10:31:13 [auto1.de] INFO: Scrape type for RC32924: 2
2026-03-29 10:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b02d40-9955-5521-9d4f-8f622c06155b with identifier: RC32924
2026-03-29 10:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b02d40-9955-5521-9d4f-8f622c06155b with scrape type 2
2026-03-29 10:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b02d40-9955-5521-9d4f-8f622c06155b with scrape type 2
2026-03-29 10:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93b02d40-9955-5521-9d4f-8f622c06155b, identifier: RC32924
2026-03-29 10:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93b02d40-9955-5521-9d4f-8f622c06155b with identifier: RC32924
2026-03-29 10:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93b02d40-9955-5521-9d4f-8f622c06155b with identifier: RC32924
2026-03-29 10:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93b02d40-9955-5521-9d4f-8f622c06155b with identifier: RC32924 to the API
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:41:39Z',
'fuel_type': 'diesel',
'id': '93b02d40-9955-5521-9d4f-8f622c06155b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC32924',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 244449,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-02',
'seller_name': None,
'title': 'Seat Altea 2.0 TDI Comfort Limited',
'transmission': 'automatic',
'trim': 'Comfort Limited',
'year': 2008}
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-29 10:31:14 [auto1.de] INFO: Saving data for RC32924: {'auction_closing_time': 1774885299.0, 'created_time': 1773468575.479436, 'last_price_update_time': 1774780274.360042}
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC32924') HTTP/1.1" 204 0
2026-03-29 10:31:14 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-29 10:31:14 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-29 10:31:14 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN76849%27 HTTP/1.1" 200 None
2026-03-29 10:31:14 [auto1.de] INFO: Scrape type for XN76849: 1
2026-03-29 10:31:14 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-29 10:31:14 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-29 10:31:14 [auto1.de] INFO: Scrape type for XF10018: 2
2026-03-29 10:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with identifier: XF10018
2026-03-29 10:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with scrape type 2
2026-03-29 10:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with scrape type 2
2026-03-29 10:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa, identifier: XF10018
2026-03-29 10:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with identifier: XF10018
2026-03-29 10:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with identifier: XF10018
2026-03-29 10:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa with identifier: XF10018 to the API
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:21:27Z',
'fuel_type': 'petrol',
'id': '65b9c3bf-c416-5fb5-afbf-5c24c9da1ffa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF10018',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 113972,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-29',
'seller_name': None,
'title': 'Ford Focus 1.6 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2003}
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-29 10:31:14 [auto1.de] INFO: Saving data for XF10018: {'auction_closing_time': 1774884087.0, 'created_time': 1774637026.351342, 'last_price_update_time': 1774780274.859009}
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF10018') HTTP/1.1" 204 0
2026-03-29 10:31:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:14 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-29 10:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-29 10:31:15 [auto1.de] INFO: Scrape type for TJ48176: 2
2026-03-29 10:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with identifier: TJ48176
2026-03-29 10:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with scrape type 2
2026-03-29 10:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with scrape type 2
2026-03-29 10:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31cb73c7-b46e-5ebf-909b-fd53b8990e56, identifier: TJ48176
2026-03-29 10:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with identifier: TJ48176
2026-03-29 10:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with identifier: TJ48176
2026-03-29 10:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31cb73c7-b46e-5ebf-909b-fd53b8990e56 with identifier: TJ48176 to the API
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:53:28Z',
'fuel_type': 'diesel',
'id': '31cb73c7-b46e-5ebf-909b-fd53b8990e56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ48176',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XE',
'odometer': 150311,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-28',
'seller_name': None,
'title': 'Jaguar XE 20d Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2016}
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-29 10:31:15 [auto1.de] INFO: Saving data for TJ48176: {'auction_closing_time': 1774886008.0, 'created_time': 1774463596.861935, 'last_price_update_time': 1774780275.441673}
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ48176') HTTP/1.1" 204 0
2026-03-29 10:31:15 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-29 10:31:15 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07339%27 HTTP/1.1" 200 None
2026-03-29 10:31:15 [auto1.de] INFO: Scrape type for WW07339: 2
2026-03-29 10:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with identifier: WW07339
2026-03-29 10:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with scrape type 2
2026-03-29 10:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with scrape type 2
2026-03-29 10:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e, identifier: WW07339
2026-03-29 10:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with identifier: WW07339
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 10:31:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with identifier: WW07339
2026-03-29 10:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 130a45ca-a8c0-5dc9-9177-d7e6bd73c71e with identifier: WW07339 to the API
2026-03-29 10:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:45:23Z',
'fuel_type': 'petrol',
'id': '130a45ca-a8c0-5dc9-9177-d7e6bd73c71e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW07339',
'listing': 'auction',
'make': 'Subaru',
'model': 'Justy',
'odometer': 228616,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-17',
'seller_name': None,
'title': 'Subaru Justy 1.0 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2009}
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07339%27 HTTP/1.1" 200 None
2026-03-29 10:31:16 [auto1.de] INFO: Saving data for WW07339: {'auction_closing_time': 1774885523.0, 'created_time': 1773860459.951665, 'last_price_update_time': 1774780276.15903}
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW07339') HTTP/1.1" 204 0
2026-03-29 10:31:16 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-29 10:31:16 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-29 10:31:16 [auto1.de] INFO: Scrape type for HT08782: 2
2026-03-29 10:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with identifier: HT08782
2026-03-29 10:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with scrape type 2
2026-03-29 10:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with scrape type 2
2026-03-29 10:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02, identifier: HT08782
2026-03-29 10:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with identifier: HT08782
2026-03-29 10:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with identifier: HT08782
2026-03-29 10:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b10d11d-caf5-5e4e-afa8-52a1e96bde02 with identifier: HT08782 to the API
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:16:34Z',
'fuel_type': 'petrol',
'id': '7b10d11d-caf5-5e4e-afa8-52a1e96bde02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT08782',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 147785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-18',
'seller_name': None,
'title': 'Mazda 2 1.3 Impuls',
'transmission': 'manual',
'trim': 'Impuls',
'year': 2010}
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-29 10:31:16 [auto1.de] INFO: Saving data for HT08782: {'auction_closing_time': 1774883794.0, 'created_time': 1773858993.78401, 'last_price_update_time': 1774780276.633897}
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT08782') HTTP/1.1" 204 0
2026-03-29 10:31:16 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH53806%27 HTTP/1.1" 200 None
2026-03-29 10:31:16 [auto1.de] INFO: Scrape type for UH53806: 2
2026-03-29 10:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9582c0ae-baed-506d-9ed4-36a06b54fa34 with identifier: UH53806
2026-03-29 10:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9582c0ae-baed-506d-9ed4-36a06b54fa34 with scrape type 2
2026-03-29 10:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9582c0ae-baed-506d-9ed4-36a06b54fa34 with scrape type 2
2026-03-29 10:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9582c0ae-baed-506d-9ed4-36a06b54fa34, identifier: UH53806
2026-03-29 10:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX43483> (referer: https://www.auto1.com/v1/car-details-view/PX43483/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9582c0ae-baed-506d-9ed4-36a06b54fa34 with identifier: UH53806
2026-03-29 10:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9582c0ae-baed-506d-9ed4-36a06b54fa34 with identifier: UH53806
2026-03-29 10:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9582c0ae-baed-506d-9ed4-36a06b54fa34 with identifier: UH53806 to the API
2026-03-29 10:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:35:38Z',
'fuel_type': 'petrol',
'id': '9582c0ae-baed-506d-9ed4-36a06b54fa34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH53806',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 92513,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-21',
'seller_name': None,
'title': 'Volkswagen Polo 1.2',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH53806%27 HTTP/1.1" 200 None
2026-03-29 10:31:17 [auto1.de] INFO: Saving data for UH53806: {'auction_closing_time': 1774884938.0, 'created_time': 1773830026.394437, 'last_price_update_time': 1774780277.136776}
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH53806') HTTP/1.1" 204 0
2026-03-29 10:31:17 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-29 10:31:17 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-29 10:31:17 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-29 10:31:17 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-29 10:31:17 [auto1.de] INFO: Scrape type for VC28435: 2
2026-03-29 10:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bca1d92-4a16-5add-acfe-5d582413c9e8 with identifier: VC28435
2026-03-29 10:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bca1d92-4a16-5add-acfe-5d582413c9e8 with scrape type 2
2026-03-29 10:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bca1d92-4a16-5add-acfe-5d582413c9e8 with scrape type 2
2026-03-29 10:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bca1d92-4a16-5add-acfe-5d582413c9e8, identifier: VC28435
2026-03-29 10:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bca1d92-4a16-5add-acfe-5d582413c9e8 with identifier: VC28435
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 10:31:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bca1d92-4a16-5add-acfe-5d582413c9e8 with identifier: VC28435
2026-03-29 10:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bca1d92-4a16-5add-acfe-5d582413c9e8 with identifier: VC28435 to the API
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:28:03Z',
'fuel_type': 'gas',
'id': '7bca1d92-4a16-5add-acfe-5d582413c9e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC28435',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 281030,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-03',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 Kasten EcoFuel',
'transmission': 'manual',
'trim': 'Kasten EcoFuel',
'year': 2008}
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-29 10:31:17 [auto1.de] INFO: Saving data for VC28435: {'auction_closing_time': 1774884483.0, 'created_time': 1773467637.420659, 'last_price_update_time': 1774780277.782485}
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC28435') HTTP/1.1" 204 0
2026-03-29 10:31:17 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-29 10:31:17 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-29 10:31:17 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT35568%27 HTTP/1.1" 200 None
2026-03-29 10:31:17 [auto1.de] INFO: Scrape type for GT35568: 2
2026-03-29 10:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with identifier: GT35568
2026-03-29 10:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with scrape type 2
2026-03-29 10:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with scrape type 2
2026-03-29 10:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0, identifier: GT35568
2026-03-29 10:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with identifier: GT35568
2026-03-29 10:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with identifier: GT35568
2026-03-29 10:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab83750-9366-5dd9-8fe5-04bbb7feaab0 with identifier: GT35568 to the API
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:41:36Z',
'fuel_type': 'petrol',
'id': '8ab83750-9366-5dd9-8fe5-04bbb7feaab0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT35568',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 200001,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-14',
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 2007}
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT35568%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [auto1.de] INFO: Saving data for GT35568: {'auction_closing_time': 1774885296.0, 'created_time': 1773687923.907596, 'last_price_update_time': 1774780278.251611}
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT35568') HTTP/1.1" 204 0
2026-03-29 10:31:18 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ90592%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [auto1.de] INFO: Scrape type for TJ90592: 2
2026-03-29 10:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d877cb38-0d56-5c78-b126-41477dbd36bd with identifier: TJ90592
2026-03-29 10:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d877cb38-0d56-5c78-b126-41477dbd36bd with scrape type 2
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d877cb38-0d56-5c78-b126-41477dbd36bd with scrape type 2
2026-03-29 10:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d877cb38-0d56-5c78-b126-41477dbd36bd, identifier: TJ90592
2026-03-29 10:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18f11b17-0b15-57ec-944c-16c43066bff1 with identifier: PX43483
2026-03-29 10:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18f11b17-0b15-57ec-944c-16c43066bff1 with scrape type 1
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18f11b17-0b15-57ec-944c-16c43066bff1
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_abf36efcbc15f87094cd181b3a544385.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_abf36efcbc15f87094cd181b3a544385.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_ee2285446fd669f3ff00776a0be4b946.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_ee2285446fd669f3ff00776a0be4b946.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_ecae6fded6a7d5adeca9a74f3e0d6bab.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_ecae6fded6a7d5adeca9a74f3e0d6bab.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_994afec4cc62b2b7b23d8a88f0ddded5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_994afec4cc62b2b7b23d8a88f0ddded5.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_caeb1c8502cc572b4fc7db9e2c477010.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_caeb1c8502cc572b4fc7db9e2c477010.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_c8ea20e823a8cb325493aaf6580a39bc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_c8ea20e823a8cb325493aaf6580a39bc.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_5df46689f49c4731ec07e67785448901.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_5df46689f49c4731ec07e67785448901.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_d66684c91ba5416ab957eb55d1514f30.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_d66684c91ba5416ab957eb55d1514f30.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_38fdc6723dab52b9b333d2af3d3589a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_38fdc6723dab52b9b333d2af3d3589a0.jpg already downloaded
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fe2%252F4ce2d5a9417f97f03ecf0c29c834acac%252Fpa%252FPX43483_1e659819eb352e6e5f084047c60b3df1.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_1e659819eb352e6e5f084047c60b3df1.jpg already downloaded
2026-03-29 10:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18f11b17-0b15-57ec-944c-16c43066bff1, identifier: PX43483
2026-03-29 10:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d877cb38-0d56-5c78-b126-41477dbd36bd with identifier: TJ90592
2026-03-29 10:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d877cb38-0d56-5c78-b126-41477dbd36bd with identifier: TJ90592
2026-03-29 10:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d877cb38-0d56-5c78-b126-41477dbd36bd with identifier: TJ90592 to the API
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:08:20Z',
'fuel_type': 'diesel',
'id': 'd877cb38-0d56-5c78-b126-41477dbd36bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ90592',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 86704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-22',
'seller_name': None,
'title': 'Opel Zafira Tourer 2.0 CDTI Drive',
'transmission': 'automatic',
'trim': 'Drive',
'year': 2015}
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ90592%27 HTTP/1.1" 200 None
2026-03-29 10:31:19 [auto1.de] INFO: Saving data for TJ90592: {'auction_closing_time': 1774883300.0, 'created_time': 1774550517.125127, 'last_price_update_time': 1774780279.104696}
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ90592') HTTP/1.1" 204 0
2026-03-29 10:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18f11b17-0b15-57ec-944c-16c43066bff1 with identifier: PX43483
2026-03-29 10:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18f11b17-0b15-57ec-944c-16c43066bff1 with identifier: PX43483
2026-03-29 10:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18f11b17-0b15-57ec-944c-16c43066bff1 with identifier: PX43483 to the API
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX43483>
{'auction_title': '',
'c_o_2_emission_value': 181,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:55:58Z',
'fuel_type': 'diesel',
'id': '18f11b17-0b15-57ec-944c-16c43066bff1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX43483',
'listing': 'auction',
'location': 'DE, Kerpen',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 163426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_abf36efcbc15f87094cd181b3a544385.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_ee2285446fd669f3ff00776a0be4b946.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_ecae6fded6a7d5adeca9a74f3e0d6bab.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_994afec4cc62b2b7b23d8a88f0ddded5.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_caeb1c8502cc572b4fc7db9e2c477010.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_c8ea20e823a8cb325493aaf6580a39bc.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_5df46689f49c4731ec07e67785448901.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_d66684c91ba5416ab957eb55d1514f30.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_38fdc6723dab52b9b333d2af3d3589a0.jpg',
'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_1e659819eb352e6e5f084047c60b3df1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_abf36efcbc15f87094cd181b3a544385.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_ee2285446fd669f3ff00776a0be4b946.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_ecae6fded6a7d5adeca9a74f3e0d6bab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_994afec4cc62b2b7b23d8a88f0ddded5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_caeb1c8502cc572b4fc7db9e2c477010.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_c8ea20e823a8cb325493aaf6580a39bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_5df46689f49c4731ec07e67785448901.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_d66684c91ba5416ab957eb55d1514f30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_38fdc6723dab52b9b333d2af3d3589a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18f11b17-0b15-57ec-944c-16c43066bff1/18f11b17-0b15-57ec-944c-16c43066bff1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/e2/4ce2d5a9417f97f03ecf0c29c834acac/pa/PX43483_1e659819eb352e6e5f084047c60b3df1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-08-28',
'seats_number': 4,
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2011}
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX43483%27 HTTP/1.1" 200 None
2026-03-29 10:31:19 [auto1.de] INFO: Saving data for PX43483: {'created_time': 1774780279.459557, 'last_price_update_time': 1774780279.459568, 'auction_closing_time': 1774886158.0}
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX43483') HTTP/1.1" 204 0
2026-03-29 10:31:19 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-29 10:31:19 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-29 10:31:19 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-29 10:31:19 [auto1.de] INFO: Scrape type for CV58900: 2
2026-03-29 10:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdc2634c-adea-598c-887d-0ca33258d67c with identifier: CV58900
2026-03-29 10:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdc2634c-adea-598c-887d-0ca33258d67c with scrape type 2
2026-03-29 10:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdc2634c-adea-598c-887d-0ca33258d67c with scrape type 2
2026-03-29 10:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdc2634c-adea-598c-887d-0ca33258d67c, identifier: CV58900
2026-03-29 10:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdc2634c-adea-598c-887d-0ca33258d67c with identifier: CV58900
2026-03-29 10:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdc2634c-adea-598c-887d-0ca33258d67c with identifier: CV58900
2026-03-29 10:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdc2634c-adea-598c-887d-0ca33258d67c with identifier: CV58900 to the API
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:47:51Z',
'fuel_type': 'petrol',
'id': 'bdc2634c-adea-598c-887d-0ca33258d67c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV58900',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 127789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-26',
'seller_name': None,
'title': 'Mazda 2 1.25 Comfort',
'transmission': 'manual',
'trim': '1.5 Comfort',
'year': 2007}
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-29 10:31:19 [auto1.de] INFO: Saving data for CV58900: {'auction_closing_time': 1774885671.0, 'created_time': 1773467796.821622, 'last_price_update_time': 1774780279.907606}
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV58900') HTTP/1.1" 204 0
2026-03-29 10:31:19 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG53469%27 HTTP/1.1" 200 None
2026-03-29 10:31:19 [auto1.de] INFO: Scrape type for RG53469: 1
2026-03-29 10:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN76849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:19 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-29 10:31:19 [auto1.de] INFO: Scrape type for AT97457: 2
2026-03-29 10:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with identifier: AT97457
2026-03-29 10:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with scrape type 2
2026-03-29 10:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with scrape type 2
2026-03-29 10:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5, identifier: AT97457
2026-03-29 10:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with identifier: AT97457
2026-03-29 10:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with identifier: AT97457
2026-03-29 10:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3cf4d08-105e-58a5-be2c-45d8b81b7bc5 with identifier: AT97457 to the API
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:36:19Z',
'fuel_type': 'petrol',
'id': 'd3cf4d08-105e-58a5-be2c-45d8b81b7bc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT97457',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 118136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-13',
'seller_name': None,
'title': 'Peugeot 207 1.4 Exécutive',
'transmission': 'manual',
'trim': 'Exécutive',
'year': 2007}
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-29 10:31:20 [auto1.de] INFO: Saving data for AT97457: {'auction_closing_time': 1774884979.0, 'created_time': 1774637103.892126, 'last_price_update_time': 1774780280.433984}
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT97457') HTTP/1.1" 204 0
2026-03-29 10:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:20 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 6726 | hits on page: 40
2026-03-29 10:31:20 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS41181%27 HTTP/1.1" 200 None
2026-03-29 10:31:20 [auto1.de] INFO: Scrape type for DS41181: 2
2026-03-29 10:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0380dcce-71c1-5496-8471-38d71ca3c2b0 with identifier: DS41181
2026-03-29 10:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0380dcce-71c1-5496-8471-38d71ca3c2b0 with scrape type 2
2026-03-29 10:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0380dcce-71c1-5496-8471-38d71ca3c2b0 with scrape type 2
2026-03-29 10:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0380dcce-71c1-5496-8471-38d71ca3c2b0, identifier: DS41181
2026-03-29 10:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0380dcce-71c1-5496-8471-38d71ca3c2b0 with identifier: DS41181
2026-03-29 10:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0380dcce-71c1-5496-8471-38d71ca3c2b0 with identifier: DS41181
2026-03-29 10:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0380dcce-71c1-5496-8471-38d71ca3c2b0 with identifier: DS41181 to the API
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:52:38Z',
'fuel_type': 'petrol',
'id': '0380dcce-71c1-5496-8471-38d71ca3c2b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS41181',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 108487,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-31',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition "111 Jahre"',
'transmission': 'manual',
'trim': 'Edition "111 Jahre"',
'year': 2010}
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS41181%27 HTTP/1.1" 200 None
2026-03-29 10:31:20 [auto1.de] INFO: Saving data for DS41181: {'auction_closing_time': 1774885958.0, 'created_time': 1773859505.631224, 'last_price_update_time': 1774780280.924352}
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS41181') HTTP/1.1" 204 0
2026-03-29 10:31:20 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-29 10:31:20 [auto1.de] INFO: Scrape type for NW73502: 2
2026-03-29 10:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a491d60-8326-519a-b074-575ebff9da3e with identifier: NW73502
2026-03-29 10:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a491d60-8326-519a-b074-575ebff9da3e with scrape type 2
2026-03-29 10:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a491d60-8326-519a-b074-575ebff9da3e with scrape type 2
2026-03-29 10:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a491d60-8326-519a-b074-575ebff9da3e, identifier: NW73502
2026-03-29 10:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:21 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY61426%27 HTTP/1.1" 200 None
2026-03-29 10:31:21 [auto1.de] INFO: Scrape type for WY61426: 2
2026-03-29 10:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 995eec35-b357-5e59-81d8-5091672dc975 with identifier: WY61426
2026-03-29 10:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 995eec35-b357-5e59-81d8-5091672dc975 with scrape type 2
2026-03-29 10:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 995eec35-b357-5e59-81d8-5091672dc975 with scrape type 2
2026-03-29 10:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 995eec35-b357-5e59-81d8-5091672dc975, identifier: WY61426
2026-03-29 10:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a491d60-8326-519a-b074-575ebff9da3e with identifier: NW73502
2026-03-29 10:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a491d60-8326-519a-b074-575ebff9da3e with identifier: NW73502
2026-03-29 10:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a491d60-8326-519a-b074-575ebff9da3e with identifier: NW73502 to the API
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:00:15Z',
'fuel_type': 'petrol',
'id': '8a491d60-8326-519a-b074-575ebff9da3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW73502',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 317425,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-05-04',
'seller_name': None,
'title': 'BMW 6er 645 CI',
'transmission': 'manual',
'trim': '',
'year': 2004}
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-29 10:31:21 [auto1.de] INFO: Saving data for NW73502: {'auction_closing_time': 1774882815.0, 'created_time': 1774034330.250205, 'last_price_update_time': 1774780281.570872}
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW73502') HTTP/1.1" 204 0
2026-03-29 10:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 995eec35-b357-5e59-81d8-5091672dc975 with identifier: WY61426
2026-03-29 10:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 995eec35-b357-5e59-81d8-5091672dc975 with identifier: WY61426
2026-03-29 10:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 995eec35-b357-5e59-81d8-5091672dc975 with identifier: WY61426 to the API
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 182,
'expiration_date': '2026-03-30T15:59:46Z',
'fuel_type': 'petrol',
'id': '995eec35-b357-5e59-81d8-5091672dc975',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY61426',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 68375,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-08',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2018}
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY61426%27 HTTP/1.1" 200 None
2026-03-29 10:31:21 [auto1.de] INFO: Saving data for WY61426: {'auction_closing_time': 1774886386.0, 'created_time': 1773773680.689393, 'last_price_update_time': 1774780281.957363}
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY61426') HTTP/1.1" 204 0
2026-03-29 10:31:21 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV67523%27 HTTP/1.1" 200 None
2026-03-29 10:31:21 [auto1.de] INFO: Scrape type for BV67523: 1
2026-03-29 10:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:21 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-29 10:31:21 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-29 10:31:22 [auto1.de] INFO: Scrape type for BV92050: 2
2026-03-29 10:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f8b392-8071-518b-a87f-29d09bb94c67 with identifier: BV92050
2026-03-29 10:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f8b392-8071-518b-a87f-29d09bb94c67 with scrape type 2
2026-03-29 10:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f8b392-8071-518b-a87f-29d09bb94c67 with scrape type 2
2026-03-29 10:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05f8b392-8071-518b-a87f-29d09bb94c67, identifier: BV92050
2026-03-29 10:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05f8b392-8071-518b-a87f-29d09bb94c67 with identifier: BV92050
2026-03-29 10:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05f8b392-8071-518b-a87f-29d09bb94c67 with identifier: BV92050
2026-03-29 10:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05f8b392-8071-518b-a87f-29d09bb94c67 with identifier: BV92050 to the API
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:36:37Z',
'fuel_type': 'petrol',
'id': '05f8b392-8071-518b-a87f-29d09bb94c67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV92050',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 231997,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1993-02-04',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse 200 E',
'transmission': 'automatic',
'trim': '',
'year': 1993}
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-29 10:31:22 [auto1.de] INFO: Saving data for BV92050: {'auction_closing_time': 1774884997.0, 'created_time': 1774463608.812638, 'last_price_update_time': 1774780282.527683}
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV92050') HTTP/1.1" 204 0
2026-03-29 10:31:22 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01649%27 HTTP/1.1" 200 None
2026-03-29 10:31:22 [auto1.de] INFO: Scrape type for NW01649: 1
2026-03-29 10:31:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:22 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL88623%27 HTTP/1.1" 200 None
2026-03-29 10:31:22 [auto1.de] INFO: Scrape type for UL88623: 2
2026-03-29 10:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 958a3d2b-100b-5ae8-811c-6a87a035140d with identifier: UL88623
2026-03-29 10:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 958a3d2b-100b-5ae8-811c-6a87a035140d with scrape type 2
2026-03-29 10:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 958a3d2b-100b-5ae8-811c-6a87a035140d with scrape type 2
2026-03-29 10:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 958a3d2b-100b-5ae8-811c-6a87a035140d, identifier: UL88623
2026-03-29 10:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 958a3d2b-100b-5ae8-811c-6a87a035140d with identifier: UL88623
2026-03-29 10:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 958a3d2b-100b-5ae8-811c-6a87a035140d with identifier: UL88623
2026-03-29 10:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 958a3d2b-100b-5ae8-811c-6a87a035140d with identifier: UL88623 to the API
2026-03-29 10:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:09:38Z',
'fuel_type': 'petrol',
'id': '958a3d2b-100b-5ae8-811c-6a87a035140d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL88623',
'listing': 'auction',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 109444,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-08',
'seller_name': None,
'title': 'Opel Grandland X 1.2 Turbo Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2018}
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL88623%27 HTTP/1.1" 200 None
2026-03-29 10:31:23 [auto1.de] INFO: Saving data for UL88623: {'auction_closing_time': 1774883378.0, 'created_time': 1773945331.322579, 'last_price_update_time': 1774780283.180656}
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL88623') HTTP/1.1" 204 0
2026-03-29 10:31:23 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-29 10:31:23 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN44411%27 HTTP/1.1" 200 None
2026-03-29 10:31:23 [auto1.de] INFO: Scrape type for SN44411: 2
2026-03-29 10:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e95ce3b-362f-5b90-a933-cf6685f4498e with identifier: SN44411
2026-03-29 10:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e95ce3b-362f-5b90-a933-cf6685f4498e with scrape type 2
2026-03-29 10:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e95ce3b-362f-5b90-a933-cf6685f4498e with scrape type 2
2026-03-29 10:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e95ce3b-362f-5b90-a933-cf6685f4498e, identifier: SN44411
2026-03-29 10:31:23 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-29 10:31:23 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-29 10:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e95ce3b-362f-5b90-a933-cf6685f4498e with identifier: SN44411
2026-03-29 10:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e95ce3b-362f-5b90-a933-cf6685f4498e with identifier: SN44411
2026-03-29 10:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e95ce3b-362f-5b90-a933-cf6685f4498e with identifier: SN44411 to the API
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:49:54Z',
'fuel_type': 'petrol',
'id': '6e95ce3b-362f-5b90-a933-cf6685f4498e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN44411',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 101666,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-06-29',
'seller_name': None,
'title': 'Mazda 2 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2006}
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN44411%27 HTTP/1.1" 200 None
2026-03-29 10:31:23 [auto1.de] INFO: Saving data for SN44411: {'auction_closing_time': 1774885794.0, 'created_time': 1774550555.04241, 'last_price_update_time': 1774780283.64237}
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN44411') HTTP/1.1" 204 0
2026-03-29 10:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:23 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-29 10:31:23 [auto1.de] INFO: Scrape type for BJ40023: 2
2026-03-29 10:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with identifier: BJ40023
2026-03-29 10:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with scrape type 2
2026-03-29 10:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with scrape type 2
2026-03-29 10:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8, identifier: BJ40023
2026-03-29 10:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with identifier: BJ40023
2026-03-29 10:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with identifier: BJ40023
2026-03-29 10:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a1836bf-7b84-5dce-9abd-600ad1cd09b8 with identifier: BJ40023 to the API
2026-03-29 10:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:14:57Z',
'fuel_type': 'petrol',
'id': '6a1836bf-7b84-5dce-9abd-600ad1cd09b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ40023',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 206491,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-19',
'seller_name': None,
'title': 'Opel Astra 1.4 Edition "111 Jahre"',
'transmission': 'manual',
'trim': 'Edition "111 Jahre"',
'year': 2010}
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-29 10:31:24 [auto1.de] INFO: Saving data for BJ40023: {'auction_closing_time': 1774883697.0, 'created_time': 1773741255.301452, 'last_price_update_time': 1774780284.135414}
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ40023') HTTP/1.1" 204 0
2026-03-29 10:31:24 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-29 10:31:24 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-29 10:31:24 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR35896%27 HTTP/1.1" 200 None
2026-03-29 10:31:24 [auto1.de] INFO: Scrape type for VR35896: 1
2026-03-29 10:31:24 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-29 10:31:24 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-29 10:31:24 [auto1.de] INFO: Scrape type for CG76921: 2
2026-03-29 10:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with identifier: CG76921
2026-03-29 10:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with scrape type 2
2026-03-29 10:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with scrape type 2
2026-03-29 10:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5, identifier: CG76921
2026-03-29 10:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG53469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with identifier: CG76921
2026-03-29 10:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with identifier: CG76921
2026-03-29 10:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ef8c0f2-953e-5a56-9490-e11cee54bbd5 with identifier: CG76921 to the API
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:24:28Z',
'fuel_type': 'petrol',
'id': '3ef8c0f2-953e-5a56-9490-e11cee54bbd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG76921',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 193131,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-02',
'seller_name': None,
'title': 'Peugeot 207 1.6 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2010}
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-29 10:31:24 [auto1.de] INFO: Saving data for CG76921: {'auction_closing_time': 1774884268.0, 'created_time': 1774636927.087307, 'last_price_update_time': 1774780284.638598}
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG76921') HTTP/1.1" 204 0
2026-03-29 10:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:24 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14161%27 HTTP/1.1" 200 None
2026-03-29 10:31:24 [auto1.de] INFO: Scrape type for JT14161: 1
2026-03-29 10:31:24 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-29 10:31:24 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN95655%27 HTTP/1.1" 200 None
2026-03-29 10:31:24 [auto1.de] INFO: Scrape type for LN95655: 2
2026-03-29 10:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fdc891e-df5b-55c3-9a01-af9f940861c2 with identifier: LN95655
2026-03-29 10:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fdc891e-df5b-55c3-9a01-af9f940861c2 with scrape type 2
2026-03-29 10:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fdc891e-df5b-55c3-9a01-af9f940861c2 with scrape type 2
2026-03-29 10:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fdc891e-df5b-55c3-9a01-af9f940861c2, identifier: LN95655
2026-03-29 10:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fdc891e-df5b-55c3-9a01-af9f940861c2 with identifier: LN95655
2026-03-29 10:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fdc891e-df5b-55c3-9a01-af9f940861c2 with identifier: LN95655
2026-03-29 10:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fdc891e-df5b-55c3-9a01-af9f940861c2 with identifier: LN95655 to the API
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:48:19Z',
'fuel_type': 'diesel',
'id': '1fdc891e-df5b-55c3-9a01-af9f940861c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN95655',
'listing': 'auction',
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 114729,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-25',
'seller_name': None,
'title': 'Jaguar F-Pace 25d R-Sport AWD',
'transmission': 'automatic',
'trim': 'R-Sport AWD',
'year': 2018}
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN95655%27 HTTP/1.1" 200 None
2026-03-29 10:31:25 [auto1.de] INFO: Saving data for LN95655: {'auction_closing_time': 1774885699.0, 'created_time': 1774378065.626057, 'last_price_update_time': 1774780285.310854}
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN95655') HTTP/1.1" 204 0
2026-03-29 10:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:25 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-29 10:31:25 [auto1.de] INFO: Scrape type for WF02803: 2
2026-03-29 10:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with identifier: WF02803
2026-03-29 10:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with scrape type 2
2026-03-29 10:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with scrape type 2
2026-03-29 10:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7, identifier: WF02803
2026-03-29 10:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with identifier: WF02803
2026-03-29 10:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with identifier: WF02803
2026-03-29 10:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ba1cbac-68d6-53c7-aea6-b09faa682ac7 with identifier: WF02803 to the API
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:59:07Z',
'fuel_type': 'diesel',
'id': '5ba1cbac-68d6-53c7-aea6-b09faa682ac7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF02803',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 151727,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-25',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2015}
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-29 10:31:25 [auto1.de] INFO: Saving data for WF02803: {'auction_closing_time': 1774886347.0, 'created_time': 1773513089.472475, 'last_price_update_time': 1774780285.78173}
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF02803') HTTP/1.1" 204 0
2026-03-29 10:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:25 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-29 10:31:25 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-29 10:31:25 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-29 10:31:25 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP19661%27 HTTP/1.1" 200 None
2026-03-29 10:31:25 [auto1.de] INFO: Scrape type for HP19661: 2
2026-03-29 10:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8238ec44-0383-5046-be1a-e7c42cc33bdb with identifier: HP19661
2026-03-29 10:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8238ec44-0383-5046-be1a-e7c42cc33bdb with scrape type 2
2026-03-29 10:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8238ec44-0383-5046-be1a-e7c42cc33bdb with scrape type 2
2026-03-29 10:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8238ec44-0383-5046-be1a-e7c42cc33bdb, identifier: HP19661
2026-03-29 10:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN76849> (referer: https://www.auto1.com/v1/car-details-view/XN76849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV67523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8238ec44-0383-5046-be1a-e7c42cc33bdb with identifier: HP19661
2026-03-29 10:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8238ec44-0383-5046-be1a-e7c42cc33bdb with identifier: HP19661
2026-03-29 10:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8238ec44-0383-5046-be1a-e7c42cc33bdb with identifier: HP19661 to the API
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:08:28Z',
'fuel_type': 'petrol',
'id': '8238ec44-0383-5046-be1a-e7c42cc33bdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP19661',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 91691,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-05-26',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 Kombi',
'transmission': 'manual',
'trim': 'Kombi',
'year': 2005}
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP19661%27 HTTP/1.1" 200 None
2026-03-29 10:31:26 [auto1.de] INFO: Saving data for HP19661: {'auction_closing_time': 1774883308.0, 'created_time': 1774550615.240825, 'last_price_update_time': 1774780286.289022}
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP19661') HTTP/1.1" 204 0
2026-03-29 10:31:26 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 6726 | hits on page: 40
2026-03-29 10:31:26 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-29 10:31:26 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-29 10:31:26 [auto1.de] INFO: Scrape type for FA69463: 2
2026-03-29 10:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8997a21-bf40-5799-9a09-62dcdd2b49c7 with identifier: FA69463
2026-03-29 10:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8997a21-bf40-5799-9a09-62dcdd2b49c7 with scrape type 2
2026-03-29 10:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8997a21-bf40-5799-9a09-62dcdd2b49c7 with scrape type 2
2026-03-29 10:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8997a21-bf40-5799-9a09-62dcdd2b49c7, identifier: FA69463
2026-03-29 10:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8997a21-bf40-5799-9a09-62dcdd2b49c7 with identifier: FA69463
2026-03-29 10:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8997a21-bf40-5799-9a09-62dcdd2b49c7 with identifier: FA69463
2026-03-29 10:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8997a21-bf40-5799-9a09-62dcdd2b49c7 with identifier: FA69463 to the API
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:52:58Z',
'fuel_type': 'diesel',
'id': 'e8997a21-bf40-5799-9a09-62dcdd2b49c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA69463',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 198185,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-02',
'seller_name': None,
'title': 'Volvo XC60 2.4D DRIVe Summum Drive',
'transmission': 'manual',
'trim': 'Summum Drive',
'year': 2009}
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-29 10:31:26 [auto1.de] INFO: Saving data for FA69463: {'auction_closing_time': 1774885978.0, 'created_time': 1773513881.506305, 'last_price_update_time': 1774780286.776189}
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA69463') HTTP/1.1" 204 0
2026-03-29 10:31:26 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN24673%27 HTTP/1.1" 200 None
2026-03-29 10:31:26 [auto1.de] INFO: Scrape type for VN24673: 2
2026-03-29 10:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with identifier: VN24673
2026-03-29 10:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with scrape type 2
2026-03-29 10:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with scrape type 2
2026-03-29 10:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a, identifier: VN24673
2026-03-29 10:31:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:26 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG22836%27 HTTP/1.1" 200 None
2026-03-29 10:31:26 [auto1.de] INFO: Scrape type for WG22836: 2
2026-03-29 10:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with identifier: WG22836
2026-03-29 10:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with scrape type 2
2026-03-29 10:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with scrape type 2
2026-03-29 10:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c, identifier: WG22836
2026-03-29 10:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with identifier: VN24673
2026-03-29 10:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with identifier: VN24673
2026-03-29 10:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e32ba46-4499-5bc5-b6af-b3fb205a3b5a with identifier: VN24673 to the API
2026-03-29 10:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:40Z',
'fuel_type': 'petrol',
'id': '0e32ba46-4499-5bc5-b6af-b3fb205a3b5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN24673',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 149021,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-03-18',
'seller_name': None,
'title': 'Audi A3 1.8 Turbo Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2001}
2026-03-29 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN24673%27 HTTP/1.1" 200 None
2026-03-29 10:31:27 [auto1.de] INFO: Saving data for VN24673: {'auction_closing_time': 1774883020.0, 'created_time': 1774550523.046473, 'last_price_update_time': 1774780287.956419}
2026-03-29 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN24673') HTTP/1.1" 204 0
2026-03-29 10:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with identifier: WG22836
2026-03-29 10:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with identifier: WG22836
2026-03-29 10:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88f41d6b-1fc2-5ab4-8785-f664f32ba71c with identifier: WG22836 to the API
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:21:29Z',
'fuel_type': 'petrol',
'id': '88f41d6b-1fc2-5ab4-8785-f664f32ba71c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG22836',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 118621,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-12-03',
'seller_name': None,
'title': 'Mazda 2 1.25 Comfort',
'transmission': 'manual',
'trim': '1.5 Comfort',
'year': 2003}
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG22836%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [auto1.de] INFO: Saving data for WG22836: {'auction_closing_time': 1774884089.0, 'created_time': 1774550593.125223, 'last_price_update_time': 1774780288.449579}
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG22836') HTTP/1.1" 204 0
2026-03-29 10:31:28 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-29 10:31:28 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-29 10:31:28 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-29 10:31:28 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [auto1.de] INFO: Scrape type for ZY88037: 2
2026-03-29 10:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3bbf779-952f-540f-bf39-4589ddc71fde with identifier: ZY88037
2026-03-29 10:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3bbf779-952f-540f-bf39-4589ddc71fde with scrape type 2
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3bbf779-952f-540f-bf39-4589ddc71fde with scrape type 2
2026-03-29 10:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3bbf779-952f-540f-bf39-4589ddc71fde, identifier: ZY88037
2026-03-29 10:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW01649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with identifier: XN76849
2026-03-29 10:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with scrape type 1
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_046f6979c0ebf7dfbb784a0fe3af1cc2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_046f6979c0ebf7dfbb784a0fe3af1cc2.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_2f240e6d3b78bb301dff0d530773c5d0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_2f240e6d3b78bb301dff0d530773c5d0.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_838a89a8390243291d6bbf3704fd20e8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_838a89a8390243291d6bbf3704fd20e8.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_097f020cf7605365b486c18ef04dee8f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_097f020cf7605365b486c18ef04dee8f.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_d51cfda3096de5370c6507926d39132a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_d51cfda3096de5370c6507926d39132a.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_ab67a69f52033b41906e2fa70fb63583.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_ab67a69f52033b41906e2fa70fb63583.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_c97a1b46ac14e6a5c45e7fccc3da6ece.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_c97a1b46ac14e6a5c45e7fccc3da6ece.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_68d63e16d2bb58e5057be164d8d728dc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_68d63e16d2bb58e5057be164d8d728dc.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_71994a6603bc775beaab2c98b5e5a3f6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_71994a6603bc775beaab2c98b5e5a3f6.jpg already downloaded
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fc0%252F2bc092828ff5224e705a328fb1b6073c%252Fpa%252FXN76849_4aef0b9cc40ba2c93ba2336ccd5198f1.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_4aef0b9cc40ba2c93ba2336ccd5198f1.jpg already downloaded
2026-03-29 10:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9, identifier: XN76849
2026-03-29 10:31:28 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-29 10:31:28 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-29 10:31:28 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-29 10:31:28 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27943%27 HTTP/1.1" 200 None
2026-03-29 10:31:28 [auto1.de] INFO: Scrape type for VF27943: 2
2026-03-29 10:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with identifier: VF27943
2026-03-29 10:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with scrape type 2
2026-03-29 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with scrape type 2
2026-03-29 10:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea833b6c-3be3-50c1-98c9-7fde0aa973e4, identifier: VF27943
2026-03-29 10:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3bbf779-952f-540f-bf39-4589ddc71fde with identifier: ZY88037
2026-03-29 10:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3bbf779-952f-540f-bf39-4589ddc71fde with identifier: ZY88037
2026-03-29 10:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3bbf779-952f-540f-bf39-4589ddc71fde with identifier: ZY88037 to the API
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:06:40Z',
'fuel_type': 'petrol',
'id': 'f3bbf779-952f-540f-bf39-4589ddc71fde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY88037',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 236214,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-11',
'seller_name': None,
'title': 'Ford Focus 1.6 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2008}
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-29 10:31:29 [auto1.de] INFO: Saving data for ZY88037: {'auction_closing_time': 1774883200.0, 'created_time': 1773513822.523555, 'last_price_update_time': 1774780289.439617}
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY88037') HTTP/1.1" 204 0
2026-03-29 10:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM22337> (referer: https://www.auto1.com/v1/car-details-view/HM22337/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with identifier: XN76849
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 10:31:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with identifier: XN76849
2026-03-29 10:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 770d59f1-3dc1-5275-b5e1-1e5b9a867ed9 with identifier: XN76849 to the API
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XN76849>
{'auction_title': '',
'c_o_2_emission_value': 44,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:01:10Z',
'fuel_type': 'hybrid',
'id': '770d59f1-3dc1-5275-b5e1-1e5b9a867ed9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN76849',
'listing': 'auction',
'location': 'DE, Dortmund',
'make': 'MINI',
'model': 'Countryman',
'odometer': 34571,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_046f6979c0ebf7dfbb784a0fe3af1cc2.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_2f240e6d3b78bb301dff0d530773c5d0.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_838a89a8390243291d6bbf3704fd20e8.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_097f020cf7605365b486c18ef04dee8f.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_d51cfda3096de5370c6507926d39132a.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_ab67a69f52033b41906e2fa70fb63583.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_c97a1b46ac14e6a5c45e7fccc3da6ece.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_68d63e16d2bb58e5057be164d8d728dc.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_71994a6603bc775beaab2c98b5e5a3f6.jpg',
'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_4aef0b9cc40ba2c93ba2336ccd5198f1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_046f6979c0ebf7dfbb784a0fe3af1cc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_2f240e6d3b78bb301dff0d530773c5d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_838a89a8390243291d6bbf3704fd20e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_097f020cf7605365b486c18ef04dee8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 788864,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_d51cfda3096de5370c6507926d39132a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_ab67a69f52033b41906e2fa70fb63583.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_c97a1b46ac14e6a5c45e7fccc3da6ece.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_68d63e16d2bb58e5057be164d8d728dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_71994a6603bc775beaab2c98b5e5a3f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770d59f1-3dc1-5275-b5e1-1e5b9a867ed9/770d59f1-3dc1-5275-b5e1-1e5b9a867ed9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36932,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img2b/c0/2bc092828ff5224e705a328fb1b6073c/pa/XN76849_4aef0b9cc40ba2c93ba2336ccd5198f1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper S E Hybrid ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2019}
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN76849%27 HTTP/1.1" 200 None
2026-03-29 10:31:30 [auto1.de] INFO: Saving data for XN76849: {'created_time': 1774780290.013294, 'last_price_update_time': 1774780290.013309, 'auction_closing_time': 1774882870.0}
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN76849') HTTP/1.1" 204 0
2026-03-29 10:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with identifier: VF27943
2026-03-29 10:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with identifier: VF27943
2026-03-29 10:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea833b6c-3be3-50c1-98c9-7fde0aa973e4 with identifier: VF27943 to the API
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:42:11Z',
'fuel_type': 'petrol',
'id': 'ea833b6c-3be3-50c1-98c9-7fde0aa973e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF27943',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 87853,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-15',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2006}
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27943%27 HTTP/1.1" 200 None
2026-03-29 10:31:30 [auto1.de] INFO: Saving data for VF27943: {'auction_closing_time': 1774885331.0, 'created_time': 1773916514.28384, 'last_price_update_time': 1774780290.421228}
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF27943') HTTP/1.1" 204 0
2026-03-29 10:31:30 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-29 10:31:30 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-29 10:31:30 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02702%27 HTTP/1.1" 200 None
2026-03-29 10:31:30 [auto1.de] INFO: Scrape type for AA02702: 2
2026-03-29 10:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with identifier: AA02702
2026-03-29 10:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with scrape type 2
2026-03-29 10:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with scrape type 2
2026-03-29 10:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa, identifier: AA02702
2026-03-29 10:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR35896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:30 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-29 10:31:30 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05413%27 HTTP/1.1" 200 None
2026-03-29 10:31:30 [auto1.de] INFO: Scrape type for AF05413: 2
2026-03-29 10:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with identifier: AF05413
2026-03-29 10:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with scrape type 2
2026-03-29 10:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with scrape type 2
2026-03-29 10:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b, identifier: AF05413
2026-03-29 10:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with identifier: AA02702
2026-03-29 10:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with identifier: AA02702
2026-03-29 10:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11e9db4f-00b8-5bb1-bf3e-c13743eee6aa with identifier: AA02702 to the API
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:37:47Z',
'fuel_type': 'petrol',
'id': '11e9db4f-00b8-5bb1-bf3e-c13743eee6aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA02702',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 447278,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-12-07',
'seller_name': None,
'title': 'Peugeot 206 1.6 XS',
'transmission': 'manual',
'trim': 'XS',
'year': 1999}
2026-03-29 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02702%27 HTTP/1.1" 200 None
2026-03-29 10:31:31 [auto1.de] INFO: Saving data for AA02702: {'auction_closing_time': 1774885067.0, 'created_time': 1773686028.635727, 'last_price_update_time': 1774780291.474882}
2026-03-29 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA02702') HTTP/1.1" 204 0
2026-03-29 10:31:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with identifier: AF05413
2026-03-29 10:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with identifier: AF05413
2026-03-29 10:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b with identifier: AF05413 to the API
2026-03-29 10:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:42:07Z',
'fuel_type': 'petrol',
'id': 'a7eb26a3-cc67-544b-bfbb-7dce8e8bc64b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF05413',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 168073,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-10',
'seller_name': None,
'title': 'BMW 2er 218i Active Tourer Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2015}
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05413%27 HTTP/1.1" 200 None
2026-03-29 10:31:32 [auto1.de] INFO: Saving data for AF05413: {'auction_closing_time': 1774885327.0, 'created_time': 1773858638.513168, 'last_price_update_time': 1774780292.049913}
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF05413') HTTP/1.1" 204 0
2026-03-29 10:31:32 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-29 10:31:32 [auto1.de] INFO: Scrape type for KG90894: 2
2026-03-29 10:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a7b556-2d00-5885-8dff-d1abad71ef7a with identifier: KG90894
2026-03-29 10:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a7b556-2d00-5885-8dff-d1abad71ef7a with scrape type 2
2026-03-29 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2a7b556-2d00-5885-8dff-d1abad71ef7a with scrape type 2
2026-03-29 10:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2a7b556-2d00-5885-8dff-d1abad71ef7a, identifier: KG90894
2026-03-29 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS38701> (referer: https://www.auto1.com/v1/car-details-view/KS38701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT14161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:32 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-29 10:31:32 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU72063%27 HTTP/1.1" 200 None
2026-03-29 10:31:32 [auto1.de] INFO: Scrape type for TU72063: 2
2026-03-29 10:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59db689c-e6e9-55bd-a165-7d30f115701d with identifier: TU72063
2026-03-29 10:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59db689c-e6e9-55bd-a165-7d30f115701d with scrape type 2
2026-03-29 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59db689c-e6e9-55bd-a165-7d30f115701d with scrape type 2
2026-03-29 10:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59db689c-e6e9-55bd-a165-7d30f115701d, identifier: TU72063
2026-03-29 10:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2a7b556-2d00-5885-8dff-d1abad71ef7a with identifier: KG90894
2026-03-29 10:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2a7b556-2d00-5885-8dff-d1abad71ef7a with identifier: KG90894
2026-03-29 10:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2a7b556-2d00-5885-8dff-d1abad71ef7a with identifier: KG90894 to the API
2026-03-29 10:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:40:29Z',
'fuel_type': 'petrol',
'id': 'b2a7b556-2d00-5885-8dff-d1abad71ef7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG90894',
'listing': 'auction',
'make': 'Chrysler',
'model': '300 C',
'odometer': 161148,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-05',
'seller_name': None,
'title': 'Chrysler 300 C 3.5 AWD',
'transmission': 'automatic',
'trim': 'AWD',
'year': 2006}
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [auto1.de] INFO: Saving data for KG90894: {'auction_closing_time': 1774885229.0, 'created_time': 1773946298.709831, 'last_price_update_time': 1774780293.497413}
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG90894') HTTP/1.1" 204 0
2026-03-29 10:31:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with identifier: HM22337
2026-03-29 10:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with scrape type 1
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6080de5b-3c86-5ee7-9767-e56b5d8eea38
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_4b4a2a86c68b646db0d90780e18b5684.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_4b4a2a86c68b646db0d90780e18b5684.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_2f91ac4b0a93d56948fab366a769dcde.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_2f91ac4b0a93d56948fab366a769dcde.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_d1e19190e3a39bd9fa2cda5cd1f2841b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_d1e19190e3a39bd9fa2cda5cd1f2841b.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_781411cb9be88749edded169eb1c2192.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_781411cb9be88749edded169eb1c2192.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_6b7061cbae0af61ac0c7ccc12b83998d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_6b7061cbae0af61ac0c7ccc12b83998d.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_bdff1712c72bed8dcd7aa2833e89ce79.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_bdff1712c72bed8dcd7aa2833e89ce79.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_effd68580868ac1f179f8ef6687c158e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_effd68580868ac1f179f8ef6687c158e.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_9cdd2e8d44174fddde563584051e04ee.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_9cdd2e8d44174fddde563584051e04ee.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_024d20480467c18a0f197812f6240775.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_024d20480467c18a0f197812f6240775.jpg already downloaded
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F5f%252F365fc95d1da17e5fe641ab70334627f2%252Fpa%252FHM22337_07d1e4a0e164a11ff87ebd5f2b7a0231.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_07d1e4a0e164a11ff87ebd5f2b7a0231.jpg already downloaded
2026-03-29 10:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6080de5b-3c86-5ee7-9767-e56b5d8eea38, identifier: HM22337
2026-03-29 10:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59db689c-e6e9-55bd-a165-7d30f115701d with identifier: TU72063
2026-03-29 10:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59db689c-e6e9-55bd-a165-7d30f115701d with identifier: TU72063
2026-03-29 10:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59db689c-e6e9-55bd-a165-7d30f115701d with identifier: TU72063 to the API
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:37:48Z',
'fuel_type': 'petrol',
'id': '59db689c-e6e9-55bd-a165-7d30f115701d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU72063',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 284910,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-01-11',
'seller_name': None,
'title': 'Ford Focus 1.6 Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 1999}
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU72063%27 HTTP/1.1" 200 None
2026-03-29 10:31:34 [auto1.de] INFO: Saving data for TU72063: {'auction_closing_time': 1774885068.0, 'created_time': 1774550549.329864, 'last_price_update_time': 1774780294.10281}
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU72063') HTTP/1.1" 204 0
2026-03-29 10:31:34 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41278%27 HTTP/1.1" 200 None
2026-03-29 10:31:34 [auto1.de] INFO: Scrape type for WX41278: 2
2026-03-29 10:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efbaa066-2f65-5e30-a06a-501207fe30e0 with identifier: WX41278
2026-03-29 10:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efbaa066-2f65-5e30-a06a-501207fe30e0 with scrape type 2
2026-03-29 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efbaa066-2f65-5e30-a06a-501207fe30e0 with scrape type 2
2026-03-29 10:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efbaa066-2f65-5e30-a06a-501207fe30e0, identifier: WX41278
2026-03-29 10:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG53469> (referer: https://www.auto1.com/v1/car-details-view/RG53469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with identifier: HM22337
2026-03-29 10:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with identifier: HM22337
2026-03-29 10:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6080de5b-3c86-5ee7-9767-e56b5d8eea38 with identifier: HM22337 to the API
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HM22337>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:54:19Z',
'fuel_type': 'petrol',
'id': '6080de5b-3c86-5ee7-9767-e56b5d8eea38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM22337',
'listing': 'auction',
'location': 'DE, Germersheim',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 84539,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_4b4a2a86c68b646db0d90780e18b5684.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_2f91ac4b0a93d56948fab366a769dcde.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_d1e19190e3a39bd9fa2cda5cd1f2841b.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_781411cb9be88749edded169eb1c2192.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_6b7061cbae0af61ac0c7ccc12b83998d.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_bdff1712c72bed8dcd7aa2833e89ce79.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_effd68580868ac1f179f8ef6687c158e.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_9cdd2e8d44174fddde563584051e04ee.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_024d20480467c18a0f197812f6240775.jpg',
'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_07d1e4a0e164a11ff87ebd5f2b7a0231.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_4b4a2a86c68b646db0d90780e18b5684.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_2f91ac4b0a93d56948fab366a769dcde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_d1e19190e3a39bd9fa2cda5cd1f2841b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_781411cb9be88749edded169eb1c2192.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_6b7061cbae0af61ac0c7ccc12b83998d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_bdff1712c72bed8dcd7aa2833e89ce79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_effd68580868ac1f179f8ef6687c158e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_9cdd2e8d44174fddde563584051e04ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_024d20480467c18a0f197812f6240775.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6080de5b-3c86-5ee7-9767-e56b5d8eea38/6080de5b-3c86-5ee7-9767-e56b5d8eea38_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/5f/365fc95d1da17e5fe641ab70334627f2/pa/HM22337_07d1e4a0e164a11ff87ebd5f2b7a0231.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-29 10:31:34 [auto1.de] INFO: Saving data for HM22337: {'created_time': 1774780294.565825, 'last_price_update_time': 1774780294.565835, 'auction_closing_time': 1774886059.0}
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM22337') HTTP/1.1" 204 0
2026-03-29 10:31:34 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-29 10:31:34 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-29 10:31:34 [auto1.de] INFO: Scrape type for GC94975: 2
2026-03-29 10:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with identifier: GC94975
2026-03-29 10:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with scrape type 2
2026-03-29 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with scrape type 2
2026-03-29 10:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66af9027-17e3-51fa-9183-b7fe3a18ccb7, identifier: GC94975
2026-03-29 10:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efbaa066-2f65-5e30-a06a-501207fe30e0 with identifier: WX41278
2026-03-29 10:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efbaa066-2f65-5e30-a06a-501207fe30e0 with identifier: WX41278
2026-03-29 10:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efbaa066-2f65-5e30-a06a-501207fe30e0 with identifier: WX41278 to the API
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:05:56Z',
'fuel_type': 'petrol',
'id': 'efbaa066-2f65-5e30-a06a-501207fe30e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX41278',
'listing': 'auction',
'make': 'Citroen',
'model': 'Saxo',
'odometer': 143593,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-09-28',
'seller_name': None,
'title': 'Citroen Saxo 1.4 SX',
'transmission': 'automatic',
'trim': 'SX',
'year': 2000}
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41278%27 HTTP/1.1" 200 None
2026-03-29 10:31:35 [auto1.de] INFO: Saving data for WX41278: {'auction_closing_time': 1774883156.0, 'created_time': 1774550594.689694, 'last_price_update_time': 1774780295.058}
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX41278') HTTP/1.1" 204 0
2026-03-29 10:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with identifier: GC94975
2026-03-29 10:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with identifier: GC94975
2026-03-29 10:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66af9027-17e3-51fa-9183-b7fe3a18ccb7 with identifier: GC94975 to the API
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:44:10Z',
'fuel_type': 'petrol',
'id': '66af9027-17e3-51fa-9183-b7fe3a18ccb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC94975',
'listing': 'auction',
'make': 'Volvo',
'model': 'V50',
'odometer': 280616,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-19',
'seller_name': None,
'title': 'Volvo V50 2.5 T5 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2010}
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-29 10:31:35 [auto1.de] INFO: Saving data for GC94975: {'auction_closing_time': 1774885450.0, 'created_time': 1774636956.915607, 'last_price_update_time': 1774780295.391922}
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC94975') HTTP/1.1" 204 0
2026-03-29 10:31:35 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC66900%27 HTTP/1.1" 200 None
2026-03-29 10:31:35 [auto1.de] INFO: Scrape type for RC66900: 2
2026-03-29 10:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ee2dbab-ece9-5e33-9072-779fd6c515fe with identifier: RC66900
2026-03-29 10:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ee2dbab-ece9-5e33-9072-779fd6c515fe with scrape type 2
2026-03-29 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ee2dbab-ece9-5e33-9072-779fd6c515fe with scrape type 2
2026-03-29 10:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ee2dbab-ece9-5e33-9072-779fd6c515fe, identifier: RC66900
2026-03-29 10:31:35 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-29 10:31:35 [auto1.de] INFO: Scrape type for ZR75909: 2
2026-03-29 10:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with identifier: ZR75909
2026-03-29 10:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with scrape type 2
2026-03-29 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with scrape type 2
2026-03-29 10:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8cbfc7b-9b4e-5741-81b3-fe4230f72468, identifier: ZR75909
2026-03-29 10:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ee2dbab-ece9-5e33-9072-779fd6c515fe with identifier: RC66900
2026-03-29 10:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ee2dbab-ece9-5e33-9072-779fd6c515fe with identifier: RC66900
2026-03-29 10:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ee2dbab-ece9-5e33-9072-779fd6c515fe with identifier: RC66900 to the API
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:10:26Z',
'fuel_type': 'diesel',
'id': '4ee2dbab-ece9-5e33-9072-779fd6c515fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC66900',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 272871,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-20',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2017}
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC66900%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [auto1.de] INFO: Saving data for RC66900: {'auction_closing_time': 1774883426.0, 'created_time': 1774550584.765639, 'last_price_update_time': 1774780296.038645}
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC66900') HTTP/1.1" 204 0
2026-03-29 10:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with identifier: KS38701
2026-03-29 10:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with scrape type 1
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_6cafca6c851a72e854af6bc9cd9863bf.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_6cafca6c851a72e854af6bc9cd9863bf.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_1608ce9abddfa93b61a6788de0e445ce.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1608ce9abddfa93b61a6788de0e445ce.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_1e02af0a9b2f82a14a451faa5f1e0dcb.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1e02af0a9b2f82a14a451faa5f1e0dcb.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_f909588f31bf477666838b285663c0e4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_f909588f31bf477666838b285663c0e4.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_2d4bd06ba7e144d507529a448f19c928.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_2d4bd06ba7e144d507529a448f19c928.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_1d88711c1f4020c01f9e111c9ee79d9f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1d88711c1f4020c01f9e111c9ee79d9f.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_1f074ec5a12b4bcb11eae5902b3a8599.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1f074ec5a12b4bcb11eae5902b3a8599.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_0d6a21d968b463315d7bb9fc463fc653.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_0d6a21d968b463315d7bb9fc463fc653.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_f300a69c7401b38d906a3c3ddad3d427.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_f300a69c7401b38d906a3c3ddad3d427.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F31%252F2f31de41530d110cdd4243c4decd2647%252Fpa%252FKS38701_23b6088d1faca831983d121b3fd5dcb8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_23b6088d1faca831983d121b3fd5dcb8.jpg already downloaded
2026-03-29 10:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46, identifier: KS38701
2026-03-29 10:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff59bb02-77b9-58e4-9262-dd8d949208dc with identifier: RG53469
2026-03-29 10:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff59bb02-77b9-58e4-9262-dd8d949208dc with scrape type 1
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff59bb02-77b9-58e4-9262-dd8d949208dc
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_455e1af26f4af6b979c17d36bb8b8250.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_455e1af26f4af6b979c17d36bb8b8250.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_3af0d2e3fdef61c41fb9446a51f09bc8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_3af0d2e3fdef61c41fb9446a51f09bc8.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_a001f15d2c2be8b450c74e5e86874c1c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_a001f15d2c2be8b450c74e5e86874c1c.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_14fdfea9260b2ea65e94cb387d87b890.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_14fdfea9260b2ea65e94cb387d87b890.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_3359d17dfac9e10bf1114e9b7f78fd29.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_3359d17dfac9e10bf1114e9b7f78fd29.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_1ce7169166a76974aa94c2845f2ae378.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_1ce7169166a76974aa94c2845f2ae378.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_4823885273dbb300115396b3240c5edf.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_4823885273dbb300115396b3240c5edf.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_730a20ae937b06a48720c2a94b11b7c9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_730a20ae937b06a48720c2a94b11b7c9.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_1148453fc635648b3152aed5e40b53ee.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_1148453fc635648b3152aed5e40b53ee.jpg already downloaded
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F84%252F98842db47a956ac40968fe4eb7ba7469%252Fpa%252FRG53469_c355d8f7988ffe8c628d175f062b8195.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_c355d8f7988ffe8c628d175f062b8195.jpg already downloaded
2026-03-29 10:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff59bb02-77b9-58e4-9262-dd8d949208dc, identifier: RG53469
2026-03-29 10:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with identifier: ZR75909
2026-03-29 10:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with identifier: ZR75909
2026-03-29 10:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8cbfc7b-9b4e-5741-81b3-fe4230f72468 with identifier: ZR75909 to the API
2026-03-29 10:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:49:58Z',
'fuel_type': 'petrol',
'id': 'b8cbfc7b-9b4e-5741-81b3-fe4230f72468',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR75909',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 57196,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-10',
'seller_name': None,
'title': 'Ford C-Max 1.6 Ti-VCT Champions Edition',
'transmission': 'manual',
'trim': 'Champions Edition',
'year': 2012}
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-29 10:31:37 [auto1.de] INFO: Saving data for ZR75909: {'auction_closing_time': 1774885798.0, 'created_time': 1774637089.603083, 'last_price_update_time': 1774780297.507852}
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR75909') HTTP/1.1" 204 0
2026-03-29 10:31:37 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF58085%27 HTTP/1.1" 200 None
2026-03-29 10:31:37 [auto1.de] INFO: Scrape type for FF58085: 1
2026-03-29 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with identifier: KS38701
2026-03-29 10:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with identifier: KS38701
2026-03-29 10:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 961c2a2a-99ef-5b32-9cc0-703c8bfd3e46 with identifier: KS38701 to the API
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KS38701>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:02:24Z',
'fuel_type': 'petrol',
'id': '961c2a2a-99ef-5b32-9cc0-703c8bfd3e46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS38701',
'listing': 'auction',
'location': 'DE, Zörbig',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 81854,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_6cafca6c851a72e854af6bc9cd9863bf.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1608ce9abddfa93b61a6788de0e445ce.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1e02af0a9b2f82a14a451faa5f1e0dcb.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_f909588f31bf477666838b285663c0e4.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_2d4bd06ba7e144d507529a448f19c928.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1d88711c1f4020c01f9e111c9ee79d9f.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1f074ec5a12b4bcb11eae5902b3a8599.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_0d6a21d968b463315d7bb9fc463fc653.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_f300a69c7401b38d906a3c3ddad3d427.jpg',
'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_23b6088d1faca831983d121b3fd5dcb8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_6cafca6c851a72e854af6bc9cd9863bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1608ce9abddfa93b61a6788de0e445ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1e02af0a9b2f82a14a451faa5f1e0dcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_f909588f31bf477666838b285663c0e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_2d4bd06ba7e144d507529a448f19c928.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1d88711c1f4020c01f9e111c9ee79d9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_1f074ec5a12b4bcb11eae5902b3a8599.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_0d6a21d968b463315d7bb9fc463fc653.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_f300a69c7401b38d906a3c3ddad3d427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_961c2a2a-99ef-5b32-9cc0-703c8bfd3e46/961c2a2a-99ef-5b32-9cc0-703c8bfd3e46_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/31/2f31de41530d110cdd4243c4decd2647/pa/KS38701_23b6088d1faca831983d121b3fd5dcb8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS38701%27 HTTP/1.1" 200 None
2026-03-29 10:31:37 [auto1.de] INFO: Saving data for KS38701: {'created_time': 1774780297.90031, 'last_price_update_time': 1774780297.90032, 'auction_closing_time': 1774882944.0}
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS38701') HTTP/1.1" 204 0
2026-03-29 10:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff59bb02-77b9-58e4-9262-dd8d949208dc with identifier: RG53469
2026-03-29 10:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff59bb02-77b9-58e4-9262-dd8d949208dc with identifier: RG53469
2026-03-29 10:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff59bb02-77b9-58e4-9262-dd8d949208dc with identifier: RG53469 to the API
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG53469>
{'auction_title': '',
'c_o_2_emission_value': 46,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '2.4L',
'engine_horse_power': 188,
'expiration_date': '2026-03-30T15:32:40Z',
'fuel_type': 'hybrid',
'id': 'ff59bb02-77b9-58e4-9262-dd8d949208dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG53469',
'listing': 'auction',
'location': 'DE, Buch',
'make': 'Mitsubishi',
'model': 'Eclipse Cross',
'odometer': 49763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_455e1af26f4af6b979c17d36bb8b8250.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_3af0d2e3fdef61c41fb9446a51f09bc8.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_a001f15d2c2be8b450c74e5e86874c1c.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_14fdfea9260b2ea65e94cb387d87b890.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_3359d17dfac9e10bf1114e9b7f78fd29.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_1ce7169166a76974aa94c2845f2ae378.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_4823885273dbb300115396b3240c5edf.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_730a20ae937b06a48720c2a94b11b7c9.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_1148453fc635648b3152aed5e40b53ee.jpg',
'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_c355d8f7988ffe8c628d175f062b8195.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_455e1af26f4af6b979c17d36bb8b8250.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_3af0d2e3fdef61c41fb9446a51f09bc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_a001f15d2c2be8b450c74e5e86874c1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_14fdfea9260b2ea65e94cb387d87b890.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_3359d17dfac9e10bf1114e9b7f78fd29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_1ce7169166a76974aa94c2845f2ae378.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_4823885273dbb300115396b3240c5edf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_730a20ae937b06a48720c2a94b11b7c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_1148453fc635648b3152aed5e40b53ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff59bb02-77b9-58e4-9262-dd8d949208dc/ff59bb02-77b9-58e4-9262-dd8d949208dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/84/98842db47a956ac40968fe4eb7ba7469/pa/RG53469_c355d8f7988ffe8c628d175f062b8195.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Top 4WD',
'transmission': 'automatic',
'trim': 'Top 4WD',
'year': 2021}
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG53469%27 HTTP/1.1" 200 None
2026-03-29 10:31:38 [auto1.de] INFO: Saving data for RG53469: {'created_time': 1774780298.277851, 'last_price_update_time': 1774780298.27786, 'auction_closing_time': 1774884760.0}
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG53469') HTTP/1.1" 204 0
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT89872%27 HTTP/1.1" 200 None
2026-03-29 10:31:38 [auto1.de] INFO: Scrape type for RT89872: 1
2026-03-29 10:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR94323%27 HTTP/1.1" 200 None
2026-03-29 10:31:38 [auto1.de] INFO: Scrape type for TR94323: 2
2026-03-29 10:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc66a8f5-25ae-5d91-bb89-aac4a563639e with identifier: TR94323
2026-03-29 10:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc66a8f5-25ae-5d91-bb89-aac4a563639e with scrape type 2
2026-03-29 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc66a8f5-25ae-5d91-bb89-aac4a563639e with scrape type 2
2026-03-29 10:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc66a8f5-25ae-5d91-bb89-aac4a563639e, identifier: TR94323
2026-03-29 10:31:38 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW33550%27 HTTP/1.1" 200 None
2026-03-29 10:31:38 [auto1.de] INFO: Scrape type for YW33550: 2
2026-03-29 10:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171ee208-e936-5f33-8d86-fb1f36b81e89 with identifier: YW33550
2026-03-29 10:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171ee208-e936-5f33-8d86-fb1f36b81e89 with scrape type 2
2026-03-29 10:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171ee208-e936-5f33-8d86-fb1f36b81e89 with scrape type 2
2026-03-29 10:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 171ee208-e936-5f33-8d86-fb1f36b81e89, identifier: YW33550
2026-03-29 10:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc66a8f5-25ae-5d91-bb89-aac4a563639e with identifier: TR94323
2026-03-29 10:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc66a8f5-25ae-5d91-bb89-aac4a563639e with identifier: TR94323
2026-03-29 10:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc66a8f5-25ae-5d91-bb89-aac4a563639e with identifier: TR94323 to the API
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:52:16Z',
'fuel_type': 'diesel',
'id': 'fc66a8f5-25ae-5d91-bb89-aac4a563639e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR94323',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 209011,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-15',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2016}
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR94323%27 HTTP/1.1" 200 None
2026-03-29 10:31:38 [auto1.de] INFO: Saving data for TR94323: {'auction_closing_time': 1774885936.0, 'created_time': 1774378063.197687, 'last_price_update_time': 1774780298.861611}
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR94323') HTTP/1.1" 204 0
2026-03-29 10:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:38 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 6726 | hits on page: 40
2026-03-29 10:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 171ee208-e936-5f33-8d86-fb1f36b81e89 with identifier: YW33550
2026-03-29 10:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 171ee208-e936-5f33-8d86-fb1f36b81e89 with identifier: YW33550
2026-03-29 10:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 171ee208-e936-5f33-8d86-fb1f36b81e89 with identifier: YW33550 to the API
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:04:07Z',
'fuel_type': 'diesel',
'id': '171ee208-e936-5f33-8d86-fb1f36b81e89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW33550',
'listing': 'auction',
'make': 'Kia',
'model': 'Carnival',
'odometer': 412565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-30',
'seller_name': None,
'title': 'Kia Carnival 2.2 CRDi VGT Active',
'transmission': 'manual',
'trim': 'VGT Active',
'year': 2012}
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW33550%27 HTTP/1.1" 200 None
2026-03-29 10:31:39 [auto1.de] INFO: Saving data for YW33550: {'auction_closing_time': 1774883047.0, 'created_time': 1774550604.558615, 'last_price_update_time': 1774780299.291986}
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW33550') HTTP/1.1" 204 0
2026-03-29 10:31:39 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ33834%27 HTTP/1.1" 200 None
2026-03-29 10:31:39 [auto1.de] INFO: Scrape type for EJ33834: 2
2026-03-29 10:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413a3914-20fc-5777-99b9-31922ed9518b with identifier: EJ33834
2026-03-29 10:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413a3914-20fc-5777-99b9-31922ed9518b with scrape type 2
2026-03-29 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 413a3914-20fc-5777-99b9-31922ed9518b with scrape type 2
2026-03-29 10:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 413a3914-20fc-5777-99b9-31922ed9518b, identifier: EJ33834
2026-03-29 10:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 413a3914-20fc-5777-99b9-31922ed9518b with identifier: EJ33834
2026-03-29 10:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 413a3914-20fc-5777-99b9-31922ed9518b with identifier: EJ33834
2026-03-29 10:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 413a3914-20fc-5777-99b9-31922ed9518b with identifier: EJ33834 to the API
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:41:27Z',
'fuel_type': 'diesel',
'id': '413a3914-20fc-5777-99b9-31922ed9518b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ33834',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 110391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-12',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2016}
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ33834%27 HTTP/1.1" 200 None
2026-03-29 10:31:39 [auto1.de] INFO: Saving data for EJ33834: {'auction_closing_time': 1774885287.0, 'created_time': 1773304368.744154, 'last_price_update_time': 1774780299.788905}
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ33834') HTTP/1.1" 204 0
2026-03-29 10:31:39 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-29 10:31:39 [auto1.de] INFO: Scrape type for UJ19896: 2
2026-03-29 10:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b2b7f6-96a5-56d0-a962-46423cdfae32 with identifier: UJ19896
2026-03-29 10:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b2b7f6-96a5-56d0-a962-46423cdfae32 with scrape type 2
2026-03-29 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b2b7f6-96a5-56d0-a962-46423cdfae32 with scrape type 2
2026-03-29 10:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63b2b7f6-96a5-56d0-a962-46423cdfae32, identifier: UJ19896
2026-03-29 10:31:39 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-29 10:31:39 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN39592%27 HTTP/1.1" 200 None
2026-03-29 10:31:39 [auto1.de] INFO: Scrape type for FN39592: 2
2026-03-29 10:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1761fd98-236d-51fe-a30f-47513867503a with identifier: FN39592
2026-03-29 10:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1761fd98-236d-51fe-a30f-47513867503a with scrape type 2
2026-03-29 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1761fd98-236d-51fe-a30f-47513867503a with scrape type 2
2026-03-29 10:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1761fd98-236d-51fe-a30f-47513867503a, identifier: FN39592
2026-03-29 10:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63b2b7f6-96a5-56d0-a962-46423cdfae32 with identifier: UJ19896
2026-03-29 10:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63b2b7f6-96a5-56d0-a962-46423cdfae32 with identifier: UJ19896
2026-03-29 10:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63b2b7f6-96a5-56d0-a962-46423cdfae32 with identifier: UJ19896 to the API
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:16:04Z',
'fuel_type': 'petrol',
'id': '63b2b7f6-96a5-56d0-a962-46423cdfae32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ19896',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Vento',
'odometer': 321848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1993-04-15',
'seller_name': None,
'title': 'Volkswagen Vento 1.8 GL',
'transmission': 'manual',
'trim': 'GL',
'year': 1993}
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-29 10:31:40 [auto1.de] INFO: Saving data for UJ19896: {'auction_closing_time': 1774883764.0, 'created_time': 1774463607.989343, 'last_price_update_time': 1774780300.431511}
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ19896') HTTP/1.1" 204 0
2026-03-29 10:31:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1761fd98-236d-51fe-a30f-47513867503a with identifier: FN39592
2026-03-29 10:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1761fd98-236d-51fe-a30f-47513867503a with identifier: FN39592
2026-03-29 10:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1761fd98-236d-51fe-a30f-47513867503a with identifier: FN39592 to the API
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:23:29Z',
'fuel_type': 'petrol',
'id': '1761fd98-236d-51fe-a30f-47513867503a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN39592',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 210292,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-31',
'seller_name': None,
'title': 'Renault Clio 1.2 Night & Day',
'transmission': 'manual',
'trim': 'Night & Day',
'year': 2010}
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN39592%27 HTTP/1.1" 200 None
2026-03-29 10:31:40 [auto1.de] INFO: Saving data for FN39592: {'auction_closing_time': 1774884209.0, 'created_time': 1774550543.034391, 'last_price_update_time': 1774780300.780861}
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN39592') HTTP/1.1" 204 0
2026-03-29 10:31:40 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-29 10:31:40 [auto1.de] INFO: Scrape type for LN54864: 2
2026-03-29 10:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with identifier: LN54864
2026-03-29 10:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with scrape type 2
2026-03-29 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with scrape type 2
2026-03-29 10:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a9ef21e-2010-5feb-b9de-40a6a93c7652, identifier: LN54864
2026-03-29 10:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV67523> (referer: https://www.auto1.com/v1/car-details-view/BV67523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:40 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-29 10:31:40 [auto1.de] INFO: Scrape type for VV83737: 2
2026-03-29 10:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with identifier: VV83737
2026-03-29 10:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with scrape type 2
2026-03-29 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with scrape type 2
2026-03-29 10:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c, identifier: VV83737
2026-03-29 10:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with identifier: LN54864
2026-03-29 10:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with identifier: LN54864
2026-03-29 10:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a9ef21e-2010-5feb-b9de-40a6a93c7652 with identifier: LN54864 to the API
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:39:48Z',
'fuel_type': 'petrol',
'id': '5a9ef21e-2010-5feb-b9de-40a6a93c7652',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN54864',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 210844,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-03',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2005}
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-29 10:31:41 [auto1.de] INFO: Saving data for LN54864: {'auction_closing_time': 1774885188.0, 'created_time': 1774637062.769113, 'last_price_update_time': 1774780301.416788}
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN54864') HTTP/1.1" 204 0
2026-03-29 10:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with identifier: VV83737
2026-03-29 10:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with identifier: VV83737
2026-03-29 10:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a5df0a2-e24e-5c0b-a636-aae542bb4d0c with identifier: VV83737 to the API
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:51:41Z',
'fuel_type': 'diesel',
'id': '4a5df0a2-e24e-5c0b-a636-aae542bb4d0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV83737',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 207173,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-02-29',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2004}
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-29 10:31:41 [auto1.de] INFO: Saving data for VV83737: {'auction_closing_time': 1774885901.0, 'created_time': 1773775921.08137, 'last_price_update_time': 1774780301.77265}
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV83737') HTTP/1.1" 204 0
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL28977%27 HTTP/1.1" 200 None
2026-03-29 10:31:41 [auto1.de] INFO: Scrape type for ZL28977: 1
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV56430%27 HTTP/1.1" 200 None
2026-03-29 10:31:41 [auto1.de] INFO: Scrape type for YV56430: 1
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-29 10:31:41 [auto1.de] INFO: Scrape type for FE29735: 2
2026-03-29 10:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0bcab1c-636a-5a2c-a33f-40d40a109e5c with identifier: FE29735
2026-03-29 10:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0bcab1c-636a-5a2c-a33f-40d40a109e5c with scrape type 2
2026-03-29 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0bcab1c-636a-5a2c-a33f-40d40a109e5c with scrape type 2
2026-03-29 10:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0bcab1c-636a-5a2c-a33f-40d40a109e5c, identifier: FE29735
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-29 10:31:41 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC15325%27 HTTP/1.1" 200 None
2026-03-29 10:31:41 [auto1.de] INFO: Scrape type for EC15325: 2
2026-03-29 10:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with identifier: EC15325
2026-03-29 10:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with scrape type 2
2026-03-29 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with scrape type 2
2026-03-29 10:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07, identifier: EC15325
2026-03-29 10:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0bcab1c-636a-5a2c-a33f-40d40a109e5c with identifier: FE29735
2026-03-29 10:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0bcab1c-636a-5a2c-a33f-40d40a109e5c with identifier: FE29735
2026-03-29 10:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0bcab1c-636a-5a2c-a33f-40d40a109e5c with identifier: FE29735 to the API
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:11:16Z',
'fuel_type': 'petrol',
'id': 'c0bcab1c-636a-5a2c-a33f-40d40a109e5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE29735',
'listing': 'auction',
'make': 'Honda',
'model': 'Stream',
'odometer': 194193,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-09-30',
'seller_name': None,
'title': 'Honda Stream 1.7 ES',
'transmission': 'manual',
'trim': 'ES',
'year': 2002}
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [auto1.de] INFO: Saving data for FE29735: {'auction_closing_time': 1774883476.0, 'created_time': 1774636968.439187, 'last_price_update_time': 1774780302.498381}
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE29735') HTTP/1.1" 204 0
2026-03-29 10:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7a78ee6-6592-5869-bc2b-45d05206171f with identifier: BV67523
2026-03-29 10:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a78ee6-6592-5869-bc2b-45d05206171f with scrape type 1
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7a78ee6-6592-5869-bc2b-45d05206171f
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_7bfc0014284f85199a6d4df8a6f417d5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_7bfc0014284f85199a6d4df8a6f417d5.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_1184c707c22f84576ba2aac83fa9d471.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_1184c707c22f84576ba2aac83fa9d471.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_152dd44f06eecf382d66568749d2c40d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_152dd44f06eecf382d66568749d2c40d.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_df504d4ad7d58f97d80925b5b44c5e84.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_df504d4ad7d58f97d80925b5b44c5e84.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_37c5499120cdd1c823fc64d1a909f687.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_37c5499120cdd1c823fc64d1a909f687.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_a17ca76f16f4a293b5d2884b084e1ccb.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_a17ca76f16f4a293b5d2884b084e1ccb.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_b88909f4fc16f3d7ad301e9cfe1236ba.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_b88909f4fc16f3d7ad301e9cfe1236ba.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_7ae6977b6554d345c8841b83cdcd7ee9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_7ae6977b6554d345c8841b83cdcd7ee9.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_cdf9f2d6a9523d061980d3280ffbfce1.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_cdf9f2d6a9523d061980d3280ffbfce1.jpg already downloaded
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fe9%252Fb3e9143cab24213c9ba539fc8c48d73d%252Fpa%252FBV67523_8a207bc861c590de2768ebd1f6225726.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_8a207bc861c590de2768ebd1f6225726.jpg already downloaded
2026-03-29 10:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7a78ee6-6592-5869-bc2b-45d05206171f, identifier: BV67523
2026-03-29 10:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with identifier: EC15325
2026-03-29 10:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with identifier: EC15325
2026-03-29 10:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7ebe7b0-b36d-5ff2-8a30-7aac71918b07 with identifier: EC15325 to the API
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:53:19Z',
'fuel_type': 'petrol',
'id': 'c7ebe7b0-b36d-5ff2-8a30-7aac71918b07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC15325',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 231222,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-14',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2007}
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC15325%27 HTTP/1.1" 200 None
2026-03-29 10:31:43 [auto1.de] INFO: Saving data for EC15325: {'auction_closing_time': 1774885999.0, 'created_time': 1774377822.055251, 'last_price_update_time': 1774780303.253041}
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC15325') HTTP/1.1" 204 0
2026-03-29 10:31:43 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-29 10:31:43 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-29 10:31:43 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-29 10:31:43 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-29 10:31:43 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-29 10:31:43 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW55257%27 HTTP/1.1" 200 None
2026-03-29 10:31:43 [auto1.de] INFO: Scrape type for XW55257: 2
2026-03-29 10:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: accf0361-0787-58c4-a0c7-aa6e57f4641a with identifier: XW55257
2026-03-29 10:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accf0361-0787-58c4-a0c7-aa6e57f4641a with scrape type 2
2026-03-29 10:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item accf0361-0787-58c4-a0c7-aa6e57f4641a with scrape type 2
2026-03-29 10:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: accf0361-0787-58c4-a0c7-aa6e57f4641a, identifier: XW55257
2026-03-29 10:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7a78ee6-6592-5869-bc2b-45d05206171f with identifier: BV67523
2026-03-29 10:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7a78ee6-6592-5869-bc2b-45d05206171f with identifier: BV67523
2026-03-29 10:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7a78ee6-6592-5869-bc2b-45d05206171f with identifier: BV67523 to the API
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BV67523>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:14:45Z',
'fuel_type': 'diesel',
'id': 'e7a78ee6-6592-5869-bc2b-45d05206171f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV67523',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Ford',
'model': 'Focus',
'odometer': 25778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_7bfc0014284f85199a6d4df8a6f417d5.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_1184c707c22f84576ba2aac83fa9d471.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_152dd44f06eecf382d66568749d2c40d.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_df504d4ad7d58f97d80925b5b44c5e84.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_37c5499120cdd1c823fc64d1a909f687.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_a17ca76f16f4a293b5d2884b084e1ccb.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_b88909f4fc16f3d7ad301e9cfe1236ba.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_7ae6977b6554d345c8841b83cdcd7ee9.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_cdf9f2d6a9523d061980d3280ffbfce1.jpg',
'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_8a207bc861c590de2768ebd1f6225726.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_7bfc0014284f85199a6d4df8a6f417d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_1184c707c22f84576ba2aac83fa9d471.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_152dd44f06eecf382d66568749d2c40d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_df504d4ad7d58f97d80925b5b44c5e84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_37c5499120cdd1c823fc64d1a909f687.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_a17ca76f16f4a293b5d2884b084e1ccb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_b88909f4fc16f3d7ad301e9cfe1236ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_7ae6977b6554d345c8841b83cdcd7ee9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_cdf9f2d6a9523d061980d3280ffbfce1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a78ee6-6592-5869-bc2b-45d05206171f/e7a78ee6-6592-5869-bc2b-45d05206171f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/e9/b3e9143cab24213c9ba539fc8c48d73d/pa/BV67523_8a207bc861c590de2768ebd1f6225726.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-04-02',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi EcoBlue Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2024}
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV67523%27 HTTP/1.1" 200 None
2026-03-29 10:31:43 [auto1.de] INFO: Saving data for BV67523: {'created_time': 1774780303.697476, 'last_price_update_time': 1774780303.69749, 'auction_closing_time': 1774883685.0}
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV67523') HTTP/1.1" 204 0
2026-03-29 10:31:43 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-29 10:31:43 [auto1.de] INFO: Scrape type for TL60563: 2
2026-03-29 10:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e87bf2-c906-587a-846a-6139d4b91744 with identifier: TL60563
2026-03-29 10:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e87bf2-c906-587a-846a-6139d4b91744 with scrape type 2
2026-03-29 10:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e87bf2-c906-587a-846a-6139d4b91744 with scrape type 2
2026-03-29 10:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99e87bf2-c906-587a-846a-6139d4b91744, identifier: TL60563
2026-03-29 10:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: accf0361-0787-58c4-a0c7-aa6e57f4641a with identifier: XW55257
2026-03-29 10:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: accf0361-0787-58c4-a0c7-aa6e57f4641a with identifier: XW55257
2026-03-29 10:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: accf0361-0787-58c4-a0c7-aa6e57f4641a with identifier: XW55257 to the API
2026-03-29 10:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:03:36Z',
'fuel_type': 'petrol',
'id': 'accf0361-0787-58c4-a0c7-aa6e57f4641a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW55257',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 18979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1996-09-30',
'seller_name': None,
'title': 'Ford Fiesta 1.3 Flair',
'transmission': 'manual',
'trim': 'Flair',
'year': 1996}
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW55257%27 HTTP/1.1" 200 None
2026-03-29 10:31:44 [auto1.de] INFO: Saving data for XW55257: {'auction_closing_time': 1774883016.0, 'created_time': 1773859582.83327, 'last_price_update_time': 1774780304.145383}
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW55257') HTTP/1.1" 204 0
2026-03-29 10:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT89872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99e87bf2-c906-587a-846a-6139d4b91744 with identifier: TL60563
2026-03-29 10:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99e87bf2-c906-587a-846a-6139d4b91744 with identifier: TL60563
2026-03-29 10:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99e87bf2-c906-587a-846a-6139d4b91744 with identifier: TL60563 to the API
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:47:17Z',
'fuel_type': 'petrol',
'id': '99e87bf2-c906-587a-846a-6139d4b91744',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL60563',
'listing': 'auction',
'make': 'Fiat',
'model': 'Grande Punto',
'odometer': 187433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-28',
'seller_name': None,
'title': 'Fiat Grande Punto 1.4 Start',
'transmission': 'manual',
'trim': 'Start',
'year': 2009}
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-29 10:31:44 [auto1.de] INFO: Saving data for TL60563: {'auction_closing_time': 1774885637.0, 'created_time': 1774637091.298332, 'last_price_update_time': 1774780304.492297}
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL60563') HTTP/1.1" 204 0
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-29 10:31:44 [auto1.de] INFO: Scrape type for FG48186: 2
2026-03-29 10:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c65683a5-d29c-5b69-9b3a-91a69b5bd89b with identifier: FG48186
2026-03-29 10:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c65683a5-d29c-5b69-9b3a-91a69b5bd89b with scrape type 2
2026-03-29 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c65683a5-d29c-5b69-9b3a-91a69b5bd89b with scrape type 2
2026-03-29 10:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c65683a5-d29c-5b69-9b3a-91a69b5bd89b, identifier: FG48186
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-29 10:31:44 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW84981%27 HTTP/1.1" 200 None
2026-03-29 10:31:44 [auto1.de] INFO: Scrape type for XW84981: 2
2026-03-29 10:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 731ec55a-3d50-57ae-9a14-4264915628bb with identifier: XW84981
2026-03-29 10:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731ec55a-3d50-57ae-9a14-4264915628bb with scrape type 2
2026-03-29 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 731ec55a-3d50-57ae-9a14-4264915628bb with scrape type 2
2026-03-29 10:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 731ec55a-3d50-57ae-9a14-4264915628bb, identifier: XW84981
2026-03-29 10:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c65683a5-d29c-5b69-9b3a-91a69b5bd89b with identifier: FG48186
2026-03-29 10:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c65683a5-d29c-5b69-9b3a-91a69b5bd89b with identifier: FG48186
2026-03-29 10:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c65683a5-d29c-5b69-9b3a-91a69b5bd89b with identifier: FG48186 to the API
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:35:21Z',
'fuel_type': 'petrol',
'id': 'c65683a5-d29c-5b69-9b3a-91a69b5bd89b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG48186',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 122701,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-06',
'seller_name': None,
'title': 'Dacia Duster 1.2 TCe Prestige 4x2',
'transmission': 'manual',
'trim': 'Prestige 4x2',
'year': 2014}
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-29 10:31:45 [auto1.de] INFO: Saving data for FG48186: {'auction_closing_time': 1774884921.0, 'created_time': 1773773426.276808, 'last_price_update_time': 1774780305.058231}
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG48186') HTTP/1.1" 204 0
2026-03-29 10:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW01649> (referer: https://www.auto1.com/v1/car-details-view/NW01649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 731ec55a-3d50-57ae-9a14-4264915628bb with identifier: XW84981
2026-03-29 10:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 731ec55a-3d50-57ae-9a14-4264915628bb with identifier: XW84981
2026-03-29 10:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 731ec55a-3d50-57ae-9a14-4264915628bb with identifier: XW84981 to the API
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:00:55Z',
'fuel_type': 'diesel',
'id': '731ec55a-3d50-57ae-9a14-4264915628bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW84981',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 233413,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-27',
'seller_name': None,
'title': 'Opel Astra 1.9 CDTI Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2007}
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW84981%27 HTTP/1.1" 200 None
2026-03-29 10:31:45 [auto1.de] INFO: Saving data for XW84981: {'auction_closing_time': 1774882855.0, 'created_time': 1774550604.198652, 'last_price_update_time': 1774780305.519883}
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW84981') HTTP/1.1" 204 0
2026-03-29 10:31:45 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-29 10:31:45 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-29 10:31:45 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB77683%27 HTTP/1.1" 200 None
2026-03-29 10:31:45 [auto1.de] INFO: Scrape type for GB77683: 2
2026-03-29 10:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b843591-2833-5691-9655-bd526122f8f2 with identifier: GB77683
2026-03-29 10:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b843591-2833-5691-9655-bd526122f8f2 with scrape type 2
2026-03-29 10:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b843591-2833-5691-9655-bd526122f8f2 with scrape type 2
2026-03-29 10:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b843591-2833-5691-9655-bd526122f8f2, identifier: GB77683
2026-03-29 10:31:45 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-29 10:31:45 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-29 10:31:45 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE54390%27 HTTP/1.1" 200 None
2026-03-29 10:31:45 [auto1.de] INFO: Scrape type for XE54390: 1
2026-03-29 10:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b843591-2833-5691-9655-bd526122f8f2 with identifier: GB77683
2026-03-29 10:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b843591-2833-5691-9655-bd526122f8f2 with identifier: GB77683
2026-03-29 10:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b843591-2833-5691-9655-bd526122f8f2 with identifier: GB77683 to the API
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:30:44Z',
'fuel_type': 'petrol',
'id': '1b843591-2833-5691-9655-bd526122f8f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB77683',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 128966,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-10-19',
'seller_name': None,
'title': 'Audi A3 1.6 Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 1998}
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB77683%27 HTTP/1.1" 200 None
2026-03-29 10:31:45 [auto1.de] INFO: Saving data for GB77683: {'auction_closing_time': 1774884644.0, 'created_time': 1773344087.545874, 'last_price_update_time': 1774780305.99735}
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB77683') HTTP/1.1" 204 0
2026-03-29 10:31:46 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ39505%27 HTTP/1.1" 200 None
2026-03-29 10:31:46 [auto1.de] INFO: Scrape type for WZ39505: 2
2026-03-29 10:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with identifier: WZ39505
2026-03-29 10:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with scrape type 2
2026-03-29 10:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with scrape type 2
2026-03-29 10:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817, identifier: WZ39505
2026-03-29 10:31:46 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-29 10:31:46 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-29 10:31:46 [auto1.de] INFO: Found listing with ID: US93398
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US93398%27 HTTP/1.1" 200 None
2026-03-29 10:31:46 [auto1.de] INFO: Scrape type for US93398: 2
2026-03-29 10:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8249ca84-61f2-58cb-a953-07a073e4957f with identifier: US93398
2026-03-29 10:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8249ca84-61f2-58cb-a953-07a073e4957f with scrape type 2
2026-03-29 10:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8249ca84-61f2-58cb-a953-07a073e4957f with scrape type 2
2026-03-29 10:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8249ca84-61f2-58cb-a953-07a073e4957f, identifier: US93398
2026-03-29 10:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with identifier: WZ39505
2026-03-29 10:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with identifier: WZ39505
2026-03-29 10:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817 with identifier: WZ39505 to the API
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:54:40Z',
'fuel_type': 'petrol',
'id': 'b2fe8a46-5aa4-51f5-9eb6-8e8d2ad15817',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ39505',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 133734,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-02',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2008}
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ39505%27 HTTP/1.1" 200 None
2026-03-29 10:31:46 [auto1.de] INFO: Saving data for WZ39505: {'auction_closing_time': 1774886080.0, 'created_time': 1773469014.33106, 'last_price_update_time': 1774780306.569605}
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ39505') HTTP/1.1" 204 0
2026-03-29 10:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8249ca84-61f2-58cb-a953-07a073e4957f with identifier: US93398
2026-03-29 10:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8249ca84-61f2-58cb-a953-07a073e4957f with identifier: US93398
2026-03-29 10:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8249ca84-61f2-58cb-a953-07a073e4957f with identifier: US93398 to the API
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:28:38Z',
'fuel_type': 'petrol',
'id': '8249ca84-61f2-58cb-a953-07a073e4957f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US93398',
'listing': 'auction',
'make': 'Volvo',
'model': 'V50',
'odometer': 427105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-11-18',
'seller_name': None,
'title': 'Volvo V50 2.5 T5 Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2004}
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US93398%27 HTTP/1.1" 200 None
2026-03-29 10:31:46 [auto1.de] INFO: Saving data for US93398: {'auction_closing_time': 1774884518.0, 'created_time': 1774550548.711299, 'last_price_update_time': 1774780306.906991}
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US93398') HTTP/1.1" 204 0
2026-03-29 10:31:46 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-29 10:31:46 [auto1.de] INFO: Scrape type for YL47006: 2
2026-03-29 10:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa5eb005-b22d-5e53-b43a-af0115e83611 with identifier: YL47006
2026-03-29 10:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa5eb005-b22d-5e53-b43a-af0115e83611 with scrape type 2
2026-03-29 10:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa5eb005-b22d-5e53-b43a-af0115e83611 with scrape type 2
2026-03-29 10:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa5eb005-b22d-5e53-b43a-af0115e83611, identifier: YL47006
2026-03-29 10:31:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f50f3c7b-fd7a-5219-8b35-ea992b9249cc with identifier: NW01649
2026-03-29 10:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f50f3c7b-fd7a-5219-8b35-ea992b9249cc with scrape type 1
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f50f3c7b-fd7a-5219-8b35-ea992b9249cc
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_7ac17ddb269f48e9a9191606c11fe113.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_7ac17ddb269f48e9a9191606c11fe113.jpg already downloaded
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_6ffa6b212f352a53ec2a7977d8075b5f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_6ffa6b212f352a53ec2a7977d8075b5f.jpg already downloaded
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_5221c2781f70e9f0c18b81c17089f407.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_5221c2781f70e9f0c18b81c17089f407.jpg already downloaded
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_957a8f3d6e9cf5a7b6f66eda6077a143.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_957a8f3d6e9cf5a7b6f66eda6077a143.jpg already downloaded
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_deee78ea11ed38e764abea6e680448ea.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_deee78ea11ed38e764abea6e680448ea.jpg already downloaded
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_13f812397eed43053f1fd0b6542105fd.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_13f812397eed43053f1fd0b6542105fd.jpg already downloaded
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_1fc6c3c512080988d3a8fb35f02d72e8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_1fc6c3c512080988d3a8fb35f02d72e8.jpg already downloaded
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_3a03bc322f8e7432e0eba9052fa25468.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_3a03bc322f8e7432e0eba9052fa25468.jpg already downloaded
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_fa93174c05fde58089a64a55264a322a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_fa93174c05fde58089a64a55264a322a.jpg not downloaded yet
2026-03-29 10:31:47 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [auto1.de] INFO: Scrape type for WY12370: 2
2026-03-29 10:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850a70d8-3c55-5ea7-b452-fda69f1950a9 with identifier: WY12370
2026-03-29 10:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850a70d8-3c55-5ea7-b452-fda69f1950a9 with scrape type 2
2026-03-29 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850a70d8-3c55-5ea7-b452-fda69f1950a9 with scrape type 2
2026-03-29 10:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 850a70d8-3c55-5ea7-b452-fda69f1950a9, identifier: WY12370
2026-03-29 10:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa5eb005-b22d-5e53-b43a-af0115e83611 with identifier: YL47006
2026-03-29 10:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa5eb005-b22d-5e53-b43a-af0115e83611 with identifier: YL47006
2026-03-29 10:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa5eb005-b22d-5e53-b43a-af0115e83611 with identifier: YL47006 to the API
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:45:44Z',
'fuel_type': 'petrol',
'id': 'fa5eb005-b22d-5e53-b43a-af0115e83611',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL47006',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 209214,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-03-12',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 FSI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2006}
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-29 10:31:47 [auto1.de] INFO: Saving data for YL47006: {'auction_closing_time': 1774885544.0, 'created_time': 1774637042.402727, 'last_price_update_time': 1774780307.701403}
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL47006') HTTP/1.1" 204 0
2026-03-29 10:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 850a70d8-3c55-5ea7-b452-fda69f1950a9 with identifier: WY12370
2026-03-29 10:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 850a70d8-3c55-5ea7-b452-fda69f1950a9 with identifier: WY12370
2026-03-29 10:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 850a70d8-3c55-5ea7-b452-fda69f1950a9 with identifier: WY12370 to the API
2026-03-29 10:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:26:03Z',
'fuel_type': 'diesel',
'id': '850a70d8-3c55-5ea7-b452-fda69f1950a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY12370',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 149881,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-29',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2010}
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-29 10:31:48 [auto1.de] INFO: Saving data for WY12370: {'auction_closing_time': 1774884363.0, 'created_time': 1773467217.125431, 'last_price_update_time': 1774780308.162414}
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY12370') HTTP/1.1" 204 0
2026-03-29 10:31:48 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-29 10:31:48 [auto1.de] INFO: Scrape type for BT97276: 2
2026-03-29 10:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with identifier: BT97276
2026-03-29 10:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with scrape type 2
2026-03-29 10:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with scrape type 2
2026-03-29 10:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9, identifier: BT97276
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_b06935566637c00b92100e294f0ef55a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_b06935566637c00b92100e294f0ef55a.jpg not downloaded yet
2026-03-29 10:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with identifier: BT97276
2026-03-29 10:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with identifier: BT97276
2026-03-29 10:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9 with identifier: BT97276 to the API
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:58:00Z',
'fuel_type': 'petrol',
'id': '4e2e2c1e-aff6-5b52-9aad-2c08eb9972f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT97276',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 90840,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-18',
'seller_name': None,
'title': 'Suzuki SX4 1.6 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2011}
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-29 10:31:48 [auto1.de] INFO: Saving data for BT97276: {'auction_closing_time': 1774886280.0, 'created_time': 1773514021.870677, 'last_price_update_time': 1774780308.625909}
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT97276') HTTP/1.1" 204 0
2026-03-29 10:31:48 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-29 10:31:48 [auto1.de] INFO: Scrape type for UJ62660: 2
2026-03-29 10:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b662192d-f4e5-561c-b631-4b6338526435 with identifier: UJ62660
2026-03-29 10:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b662192d-f4e5-561c-b631-4b6338526435 with scrape type 2
2026-03-29 10:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b662192d-f4e5-561c-b631-4b6338526435 with scrape type 2
2026-03-29 10:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b662192d-f4e5-561c-b631-4b6338526435, identifier: UJ62660
2026-03-29 10:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT14161> (referer: https://www.auto1.com/v1/car-details-view/JT14161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b662192d-f4e5-561c-b631-4b6338526435 with identifier: UJ62660
2026-03-29 10:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b662192d-f4e5-561c-b631-4b6338526435 with identifier: UJ62660
2026-03-29 10:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b662192d-f4e5-561c-b631-4b6338526435 with identifier: UJ62660 to the API
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:40:16Z',
'fuel_type': 'petrol',
'id': 'b662192d-f4e5-561c-b631-4b6338526435',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ62660',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vaneo',
'odometer': 196471,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-21',
'seller_name': None,
'title': 'Mercedes-Benz Vaneo 1.6',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-29 10:31:49 [auto1.de] INFO: Saving data for UJ62660: {'auction_closing_time': 1774885216.0, 'created_time': 1773945942.047663, 'last_price_update_time': 1774780309.082941}
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ62660') HTTP/1.1" 204 0
2026-03-29 10:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF58085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:49 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-29 10:31:49 [auto1.de] INFO: Scrape type for UY36184: 2
2026-03-29 10:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with identifier: UY36184
2026-03-29 10:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with scrape type 2
2026-03-29 10:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with scrape type 2
2026-03-29 10:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f, identifier: UY36184
2026-03-29 10:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with identifier: UY36184
2026-03-29 10:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with identifier: UY36184
2026-03-29 10:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f with identifier: UY36184 to the API
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:17:33Z',
'fuel_type': 'petrol',
'id': '8daeb7aa-7514-5fd6-b42c-bce11aa9dc7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY36184',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 129754,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-09-24',
'seller_name': None,
'title': 'Volkswagen Polo 1.4',
'transmission': 'manual',
'trim': '',
'year': 2001}
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-29 10:31:49 [auto1.de] INFO: Saving data for UY36184: {'auction_closing_time': 1774883853.0, 'created_time': 1773658080.224862, 'last_price_update_time': 1774780309.531493}
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY36184') HTTP/1.1" 204 0
2026-03-29 10:31:49 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-29 10:31:49 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-29 10:31:49 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-29 10:31:49 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-29 10:31:49 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA86799%27 HTTP/1.1" 200 None
2026-03-29 10:31:49 [auto1.de] INFO: Scrape type for XA86799: 2
2026-03-29 10:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0240ce5e-e920-579b-9357-e5be0e78e72c with identifier: XA86799
2026-03-29 10:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0240ce5e-e920-579b-9357-e5be0e78e72c with scrape type 2
2026-03-29 10:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0240ce5e-e920-579b-9357-e5be0e78e72c with scrape type 2
2026-03-29 10:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0240ce5e-e920-579b-9357-e5be0e78e72c, identifier: XA86799
2026-03-29 10:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0240ce5e-e920-579b-9357-e5be0e78e72c with identifier: XA86799
2026-03-29 10:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0240ce5e-e920-579b-9357-e5be0e78e72c with identifier: XA86799
2026-03-29 10:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0240ce5e-e920-579b-9357-e5be0e78e72c with identifier: XA86799 to the API
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:47:54Z',
'fuel_type': 'diesel',
'id': '0240ce5e-e920-579b-9357-e5be0e78e72c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA86799',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 148632,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-28',
'seller_name': None,
'title': 'Mazda 3 1.5 Diesel Nakama',
'transmission': 'manual',
'trim': 'Nakama',
'year': 2016}
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA86799%27 HTTP/1.1" 200 None
2026-03-29 10:31:49 [auto1.de] INFO: Saving data for XA86799: {'auction_closing_time': 1774885674.0, 'created_time': 1773858787.253308, 'last_price_update_time': 1774780309.989124}
2026-03-29 10:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA86799') HTTP/1.1" 204 0
2026-03-29 10:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee340f3c-e505-5e60-a56b-6b813dc53f99 with identifier: JT14161
2026-03-29 10:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee340f3c-e505-5e60-a56b-6b813dc53f99 with scrape type 1
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee340f3c-e505-5e60-a56b-6b813dc53f99
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_3642a9e7d6aa802e69a81c8539f08f34.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_3642a9e7d6aa802e69a81c8539f08f34.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_f55786d0037ab7270504cbdebe0a4546.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_f55786d0037ab7270504cbdebe0a4546.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_986a7befd07037b3d6ea1c1fbb712ebf.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_986a7befd07037b3d6ea1c1fbb712ebf.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_5f8ba5d8fc0281f6399bcb4a57c71c84.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_5f8ba5d8fc0281f6399bcb4a57c71c84.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_683bca241f5692cfd9f42b121cea2d1c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_683bca241f5692cfd9f42b121cea2d1c.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_ad6c0fc5a019efd0d3ee7b88c1eebf2e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_ad6c0fc5a019efd0d3ee7b88c1eebf2e.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_ecd6bbf3a36b83e1c185795df85c0ca6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_ecd6bbf3a36b83e1c185795df85c0ca6.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_4b73c3292d1f24e74afd13a1c25b1ca8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_4b73c3292d1f24e74afd13a1c25b1ca8.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_15a7e36784e3e5f30010dd27ae479d99.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_15a7e36784e3e5f30010dd27ae479d99.jpg already downloaded
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F44%252F224437b398b2063d6e6d6eb6c54a5482%252Fpa%252FJT14161_d0b4b68dc319665f3104c2f51e25ef2d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_d0b4b68dc319665f3104c2f51e25ef2d.jpg already downloaded
2026-03-29 10:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee340f3c-e505-5e60-a56b-6b813dc53f99, identifier: JT14161
2026-03-29 10:31:50 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU99742%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [auto1.de] INFO: Scrape type for SU99742: 2
2026-03-29 10:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with identifier: SU99742
2026-03-29 10:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with scrape type 2
2026-03-29 10:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with scrape type 2
2026-03-29 10:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32, identifier: SU99742
2026-03-29 10:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee340f3c-e505-5e60-a56b-6b813dc53f99 with identifier: JT14161
2026-03-29 10:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee340f3c-e505-5e60-a56b-6b813dc53f99 with identifier: JT14161
2026-03-29 10:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee340f3c-e505-5e60-a56b-6b813dc53f99 with identifier: JT14161 to the API
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT14161>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:03Z',
'fuel_type': 'petrol',
'id': 'ee340f3c-e505-5e60-a56b-6b813dc53f99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT14161',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 41197,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_3642a9e7d6aa802e69a81c8539f08f34.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_f55786d0037ab7270504cbdebe0a4546.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_986a7befd07037b3d6ea1c1fbb712ebf.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_5f8ba5d8fc0281f6399bcb4a57c71c84.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_683bca241f5692cfd9f42b121cea2d1c.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_ad6c0fc5a019efd0d3ee7b88c1eebf2e.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_ecd6bbf3a36b83e1c185795df85c0ca6.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_4b73c3292d1f24e74afd13a1c25b1ca8.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_15a7e36784e3e5f30010dd27ae479d99.jpg',
'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_d0b4b68dc319665f3104c2f51e25ef2d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_3642a9e7d6aa802e69a81c8539f08f34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_f55786d0037ab7270504cbdebe0a4546.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_986a7befd07037b3d6ea1c1fbb712ebf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_5f8ba5d8fc0281f6399bcb4a57c71c84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_683bca241f5692cfd9f42b121cea2d1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_ad6c0fc5a019efd0d3ee7b88c1eebf2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_ecd6bbf3a36b83e1c185795df85c0ca6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_4b73c3292d1f24e74afd13a1c25b1ca8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_15a7e36784e3e5f30010dd27ae479d99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee340f3c-e505-5e60-a56b-6b813dc53f99/ee340f3c-e505-5e60-a56b-6b813dc53f99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/44/224437b398b2063d6e6d6eb6c54a5482/pa/JT14161_d0b4b68dc319665f3104c2f51e25ef2d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-22',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14161%27 HTTP/1.1" 200 None
2026-03-29 10:31:50 [auto1.de] INFO: Saving data for JT14161: {'created_time': 1774780310.769714, 'last_price_update_time': 1774780310.769728, 'auction_closing_time': 1774884123.0}
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT14161') HTTP/1.1" 204 0
2026-03-29 10:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with identifier: SU99742
2026-03-29 10:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with identifier: SU99742
2026-03-29 10:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69c4b2a5-4cc4-5207-9b46-d69fcb924f32 with identifier: SU99742 to the API
2026-03-29 10:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:28Z',
'fuel_type': 'petrol',
'id': '69c4b2a5-4cc4-5207-9b46-d69fcb924f32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU99742',
'listing': 'auction',
'make': 'Ssangyong',
'model': 'Korando',
'odometer': 83798,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-09',
'seller_name': None,
'title': 'Ssangyong Korando 2.0 Sapphire 4x4',
'transmission': 'manual',
'trim': 'Sapphire 4x4',
'year': 2018}
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU99742%27 HTTP/1.1" 200 None
2026-03-29 10:31:51 [auto1.de] INFO: Saving data for SU99742: {'auction_closing_time': 1774885348.0, 'created_time': 1773776189.462942, 'last_price_update_time': 1774780311.182334}
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU99742') HTTP/1.1" 204 0
2026-03-29 10:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:31:51 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE87532%27 HTTP/1.1" 200 None
2026-03-29 10:31:51 [auto1.de] INFO: Scrape type for ZE87532: 2
2026-03-29 10:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd8fd80-0859-5108-94ba-171ff1ce341e with identifier: ZE87532
2026-03-29 10:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd8fd80-0859-5108-94ba-171ff1ce341e with scrape type 2
2026-03-29 10:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd8fd80-0859-5108-94ba-171ff1ce341e with scrape type 2
2026-03-29 10:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fd8fd80-0859-5108-94ba-171ff1ce341e, identifier: ZE87532
2026-03-29 10:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fd8fd80-0859-5108-94ba-171ff1ce341e with identifier: ZE87532
2026-03-29 10:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fd8fd80-0859-5108-94ba-171ff1ce341e with identifier: ZE87532
2026-03-29 10:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fd8fd80-0859-5108-94ba-171ff1ce341e with identifier: ZE87532 to the API
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:13:45Z',
'fuel_type': 'petrol',
'id': '4fd8fd80-0859-5108-94ba-171ff1ce341e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE87532',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 167361,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-24',
'seller_name': None,
'title': 'Hyundai i10 1.1 Edition+',
'transmission': 'manual',
'trim': 'Edition+',
'year': 2009}
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE87532%27 HTTP/1.1" 200 None
2026-03-29 10:31:51 [auto1.de] INFO: Saving data for ZE87532: {'auction_closing_time': 1774883625.0, 'created_time': 1773830165.174128, 'last_price_update_time': 1774780311.720284}
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE87532') HTTP/1.1" 204 0
2026-03-29 10:31:51 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-29 10:31:51 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY35599%27 HTTP/1.1" 200 None
2026-03-29 10:31:51 [auto1.de] INFO: Scrape type for JY35599: 2
2026-03-29 10:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada89e0f-5213-57bd-aefd-6641dacdf237 with identifier: JY35599
2026-03-29 10:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada89e0f-5213-57bd-aefd-6641dacdf237 with scrape type 2
2026-03-29 10:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ada89e0f-5213-57bd-aefd-6641dacdf237 with scrape type 2
2026-03-29 10:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ada89e0f-5213-57bd-aefd-6641dacdf237, identifier: JY35599
2026-03-29 10:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ada89e0f-5213-57bd-aefd-6641dacdf237 with identifier: JY35599
2026-03-29 10:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ada89e0f-5213-57bd-aefd-6641dacdf237 with identifier: JY35599
2026-03-29 10:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ada89e0f-5213-57bd-aefd-6641dacdf237 with identifier: JY35599 to the API
2026-03-29 10:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:35Z',
'fuel_type': 'diesel',
'id': 'ada89e0f-5213-57bd-aefd-6641dacdf237',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY35599',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 75580,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-21',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Sound BlueMotion',
'transmission': 'automatic',
'trim': 'Sound BlueMotion',
'year': 2017}
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY35599%27 HTTP/1.1" 200 None
2026-03-29 10:31:52 [auto1.de] INFO: Saving data for JY35599: {'auction_closing_time': 1774885955.0, 'created_time': 1773398185.668254, 'last_price_update_time': 1774780312.264387}
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY35599') HTTP/1.1" 204 0
2026-03-29 10:31:52 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT45615%27 HTTP/1.1" 200 None
2026-03-29 10:31:52 [auto1.de] INFO: Scrape type for PT45615: 2
2026-03-29 10:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fedc6e7a-ace9-587b-bce2-cca52e60d26d with identifier: PT45615
2026-03-29 10:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fedc6e7a-ace9-587b-bce2-cca52e60d26d with scrape type 2
2026-03-29 10:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fedc6e7a-ace9-587b-bce2-cca52e60d26d with scrape type 2
2026-03-29 10:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fedc6e7a-ace9-587b-bce2-cca52e60d26d, identifier: PT45615
2026-03-29 10:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_fa93174c05fde58089a64a55264a322a.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fedc6e7a-ace9-587b-bce2-cca52e60d26d with identifier: PT45615
2026-03-29 10:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fedc6e7a-ace9-587b-bce2-cca52e60d26d with identifier: PT45615
2026-03-29 10:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fedc6e7a-ace9-587b-bce2-cca52e60d26d with identifier: PT45615 to the API
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:06:11Z',
'fuel_type': 'petrol',
'id': 'fedc6e7a-ace9-587b-bce2-cca52e60d26d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT45615',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 153206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-08',
'seller_name': None,
'title': 'Audi A4 45 TFSI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT45615%27 HTTP/1.1" 200 None
2026-03-29 10:31:52 [auto1.de] INFO: Saving data for PT45615: {'auction_closing_time': 1774883171.0, 'created_time': 1774032168.740015, 'last_price_update_time': 1774780312.882512}
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT45615') HTTP/1.1" 204 0
2026-03-29 10:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_b06935566637c00b92100e294f0ef55a.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:31:52 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-29 10:31:52 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-29 10:31:52 [auto1.de] INFO: Scrape type for JY67859: 2
2026-03-29 10:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821e60c9-393a-59ea-adad-ae374fb086e7 with identifier: JY67859
2026-03-29 10:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821e60c9-393a-59ea-adad-ae374fb086e7 with scrape type 2
2026-03-29 10:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 821e60c9-393a-59ea-adad-ae374fb086e7 with scrape type 2
2026-03-29 10:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 821e60c9-393a-59ea-adad-ae374fb086e7, identifier: JY67859
2026-03-29 10:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 821e60c9-393a-59ea-adad-ae374fb086e7 with identifier: JY67859
2026-03-29 10:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 821e60c9-393a-59ea-adad-ae374fb086e7 with identifier: JY67859
2026-03-29 10:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 821e60c9-393a-59ea-adad-ae374fb086e7 with identifier: JY67859 to the API
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:37:12Z',
'fuel_type': 'diesel',
'id': '821e60c9-393a-59ea-adad-ae374fb086e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY67859',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 194139,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-17',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2016}
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-29 10:31:53 [auto1.de] INFO: Saving data for JY67859: {'auction_closing_time': 1774885032.0, 'created_time': 1774637076.269851, 'last_price_update_time': 1774780313.381682}
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY67859') HTTP/1.1" 204 0
2026-03-29 10:31:53 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG41395%27 HTTP/1.1" 200 None
2026-03-29 10:31:53 [auto1.de] INFO: Scrape type for MG41395: 2
2026-03-29 10:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99823a67-082e-510e-ba7a-df9eb6f2b73c with identifier: MG41395
2026-03-29 10:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99823a67-082e-510e-ba7a-df9eb6f2b73c with scrape type 2
2026-03-29 10:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99823a67-082e-510e-ba7a-df9eb6f2b73c with scrape type 2
2026-03-29 10:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99823a67-082e-510e-ba7a-df9eb6f2b73c, identifier: MG41395
2026-03-29 10:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99823a67-082e-510e-ba7a-df9eb6f2b73c with identifier: MG41395
2026-03-29 10:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99823a67-082e-510e-ba7a-df9eb6f2b73c with identifier: MG41395
2026-03-29 10:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99823a67-082e-510e-ba7a-df9eb6f2b73c with identifier: MG41395 to the API
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:46:21Z',
'fuel_type': 'diesel',
'id': '99823a67-082e-510e-ba7a-df9eb6f2b73c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG41395',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 280961,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.9 TDI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG41395%27 HTTP/1.1" 200 None
2026-03-29 10:31:53 [auto1.de] INFO: Saving data for MG41395: {'auction_closing_time': 1774885581.0, 'created_time': 1774550575.66647, 'last_price_update_time': 1774780313.856369}
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG41395') HTTP/1.1" 204 0
2026-03-29 10:31:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-29 10:31:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-29 10:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856e5c450>
2026-03-29 10:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_fa93174c05fde58089a64a55264a322a.jpg') HTTP/1.1" 204 0
2026-03-29 10:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_fa93174c05fde58089a64a55264a322a.jpg saved to cache
2026-03-29 10:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f50f3c7b-fd7a-5219-8b35-ea992b9249cc
2026-03-29 10:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856d43850>
2026-03-29 10:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F8b%252F128b619bcac5539a222b6bdb1d526396%252Fpa%252FNW01649_b06935566637c00b92100e294f0ef55a.jpg') HTTP/1.1" 204 0
2026-03-29 10:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_b06935566637c00b92100e294f0ef55a.jpg saved to cache
2026-03-29 10:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f50f3c7b-fd7a-5219-8b35-ea992b9249cc
2026-03-29 10:31:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f50f3c7b-fd7a-5219-8b35-ea992b9249cc, skipping ID generation
2026-03-29 10:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f50f3c7b-fd7a-5219-8b35-ea992b9249cc with scrape type 1
2026-03-29 10:31:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f50f3c7b-fd7a-5219-8b35-ea992b9249cc sending to next pipeline
2026-03-29 10:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f50f3c7b-fd7a-5219-8b35-ea992b9249cc, identifier: NW01649
2026-03-29 10:31:54 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-29 10:31:54 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-29 10:31:54 [auto1.de] INFO: Scrape type for SG28932: 2
2026-03-29 10:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc623bbd-5635-5c8c-9d56-234d3e321c82 with identifier: SG28932
2026-03-29 10:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc623bbd-5635-5c8c-9d56-234d3e321c82 with scrape type 2
2026-03-29 10:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc623bbd-5635-5c8c-9d56-234d3e321c82 with scrape type 2
2026-03-29 10:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc623bbd-5635-5c8c-9d56-234d3e321c82, identifier: SG28932
2026-03-29 10:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR35896> (referer: https://www.auto1.com/v1/car-details-view/VR35896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT89872> (referer: https://www.auto1.com/v1/car-details-view/RT89872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f50f3c7b-fd7a-5219-8b35-ea992b9249cc with identifier: NW01649
2026-03-29 10:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f50f3c7b-fd7a-5219-8b35-ea992b9249cc with identifier: NW01649
2026-03-29 10:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f50f3c7b-fd7a-5219-8b35-ea992b9249cc with identifier: NW01649 to the API
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_b06935566637c00b92100e294f0ef55a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:37:39Z',
'fuel_type': 'hybrid',
'id': 'f50f3c7b-fd7a-5219-8b35-ea992b9249cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW01649',
'listing': 'auction',
'location': 'DE, Rosenheim',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 66278,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_7ac17ddb269f48e9a9191606c11fe113.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_6ffa6b212f352a53ec2a7977d8075b5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_5221c2781f70e9f0c18b81c17089f407.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_957a8f3d6e9cf5a7b6f66eda6077a143.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_deee78ea11ed38e764abea6e680448ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_13f812397eed43053f1fd0b6542105fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_1fc6c3c512080988d3a8fb35f02d72e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_3a03bc322f8e7432e0eba9052fa25468.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_fa93174c05fde58089a64a55264a322a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f50f3c7b-fd7a-5219-8b35-ea992b9249cc/f50f3c7b-fd7a-5219-8b35-ea992b9249cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/8b/128b619bcac5539a222b6bdb1d526396/pa/NW01649_b06935566637c00b92100e294f0ef55a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Trend 4WD',
'transmission': 'automatic',
'trim': 'Trend 4WD',
'year': 2021}
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01649%27 HTTP/1.1" 200 None
2026-03-29 10:31:54 [auto1.de] INFO: Saving data for NW01649: {'created_time': 1774780314.779653, 'last_price_update_time': 1774780314.779663, 'auction_closing_time': 1774885059.0}
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW01649') HTTP/1.1" 204 0
2026-03-29 10:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc623bbd-5635-5c8c-9d56-234d3e321c82 with identifier: SG28932
2026-03-29 10:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc623bbd-5635-5c8c-9d56-234d3e321c82 with identifier: SG28932
2026-03-29 10:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc623bbd-5635-5c8c-9d56-234d3e321c82 with identifier: SG28932 to the API
2026-03-29 10:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:58:54Z',
'fuel_type': 'petrol',
'id': 'cc623bbd-5635-5c8c-9d56-234d3e321c82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG28932',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 129166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Club up!',
'transmission': 'manual',
'trim': 'Club',
'year': 2016}
2026-03-29 10:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-29 10:31:55 [auto1.de] INFO: Saving data for SG28932: {'auction_closing_time': 1774886334.0, 'created_time': 1773304980.691587, 'last_price_update_time': 1774780315.95903}
2026-03-29 10:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG28932') HTTP/1.1" 204 0
2026-03-29 10:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49688d18-acd2-5c02-ab4b-7c216349aa1f with identifier: VR35896
2026-03-29 10:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49688d18-acd2-5c02-ab4b-7c216349aa1f with scrape type 1
2026-03-29 10:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49688d18-acd2-5c02-ab4b-7c216349aa1f
2026-03-29 10:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_b8fb86869f3dc9ea0f4420dd422bf62a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_b8fb86869f3dc9ea0f4420dd422bf62a.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_65de7116a20b6c649a82dc2762fff517.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_65de7116a20b6c649a82dc2762fff517.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_1df2b8f2300c291c74f13e6fed25ba90.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_1df2b8f2300c291c74f13e6fed25ba90.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_03d48b204141f0d8d11ebcfc2e58e609.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_03d48b204141f0d8d11ebcfc2e58e609.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_ef14ccec1646d758885ed03ca87dcf0f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_ef14ccec1646d758885ed03ca87dcf0f.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_0eaab59fb0510f1c43847511b0d1010a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_0eaab59fb0510f1c43847511b0d1010a.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_7878f000dc0e19cad20289e386f553e2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_7878f000dc0e19cad20289e386f553e2.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_b85bead65ef253855d0ba04fac4666c6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_b85bead65ef253855d0ba04fac4666c6.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_4316e35adef0dae8e7c97fb179a52586.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_4316e35adef0dae8e7c97fb179a52586.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff1%252Fc6f146537cfe8725545f947e8aa24cb9%252Fpa%252FVR35896_bfd1e2e76434cc0579d95be716147b2d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_bfd1e2e76434cc0579d95be716147b2d.jpg already downloaded
2026-03-29 10:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49688d18-acd2-5c02-ab4b-7c216349aa1f, identifier: VR35896
2026-03-29 10:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with identifier: RT89872
2026-03-29 10:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with scrape type 1
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 997a9cd7-3c22-5867-8c2d-9de0f5f61a43
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_30a67c8329f476dc336dd254616993d0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_30a67c8329f476dc336dd254616993d0.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_ff783b9cd229becc40fa7d5a5cef23af.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_ff783b9cd229becc40fa7d5a5cef23af.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_e106263665021b1640b0c2f4ed5536aa.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_e106263665021b1640b0c2f4ed5536aa.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_0c07c2add9627aab78521c2120200696.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_0c07c2add9627aab78521c2120200696.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_f6800e2bad877b845601ba79384f3f74.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_f6800e2bad877b845601ba79384f3f74.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_ca37ecc5e3787b95a790ba7d38244e55.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_ca37ecc5e3787b95a790ba7d38244e55.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_441d409bb6d8b134a86808ac860b3325.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_441d409bb6d8b134a86808ac860b3325.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_a46af5c7e84a1f58e01af73f460fc2d4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_a46af5c7e84a1f58e01af73f460fc2d4.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_893484cea9293d0163322d64bb5de2bc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_893484cea9293d0163322d64bb5de2bc.jpg already downloaded
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F4d%252Fb34d831ed70044c2dd460010b2d77463%252Fpa%252FRT89872_06c1067675ba0c18537ab12d71bdf007.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_06c1067675ba0c18537ab12d71bdf007.jpg already downloaded
2026-03-29 10:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43, identifier: RT89872
2026-03-29 10:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49688d18-acd2-5c02-ab4b-7c216349aa1f with identifier: VR35896
2026-03-29 10:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49688d18-acd2-5c02-ab4b-7c216349aa1f with identifier: VR35896
2026-03-29 10:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49688d18-acd2-5c02-ab4b-7c216349aa1f with identifier: VR35896 to the API
2026-03-29 10:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VR35896>
{'auction_title': '',
'c_o_2_emission_value': 170,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:10:20Z',
'fuel_type': 'diesel',
'id': '49688d18-acd2-5c02-ab4b-7c216349aa1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR35896',
'listing': 'auction',
'location': 'DE, Dortmund',
'make': 'Ford',
'model': 'S-Max',
'odometer': 111936,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_b8fb86869f3dc9ea0f4420dd422bf62a.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_65de7116a20b6c649a82dc2762fff517.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_1df2b8f2300c291c74f13e6fed25ba90.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_03d48b204141f0d8d11ebcfc2e58e609.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_ef14ccec1646d758885ed03ca87dcf0f.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_0eaab59fb0510f1c43847511b0d1010a.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_7878f000dc0e19cad20289e386f553e2.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_b85bead65ef253855d0ba04fac4666c6.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_4316e35adef0dae8e7c97fb179a52586.jpg',
'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_bfd1e2e76434cc0579d95be716147b2d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_b8fb86869f3dc9ea0f4420dd422bf62a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_65de7116a20b6c649a82dc2762fff517.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_1df2b8f2300c291c74f13e6fed25ba90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_03d48b204141f0d8d11ebcfc2e58e609.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_ef14ccec1646d758885ed03ca87dcf0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_0eaab59fb0510f1c43847511b0d1010a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_7878f000dc0e19cad20289e386f553e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_b85bead65ef253855d0ba04fac4666c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_4316e35adef0dae8e7c97fb179a52586.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49688d18-acd2-5c02-ab4b-7c216349aa1f/49688d18-acd2-5c02-ab4b-7c216349aa1f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f1/c6f146537cfe8725545f947e8aa24cb9/pa/VR35896_bfd1e2e76434cc0579d95be716147b2d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi EcoBlue ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2020}
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR35896%27 HTTP/1.1" 200 None
2026-03-29 10:31:57 [auto1.de] INFO: Saving data for VR35896: {'created_time': 1774780317.494969, 'last_price_update_time': 1774780317.494981, 'auction_closing_time': 1774883420.0}
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR35896') HTTP/1.1" 204 0
2026-03-29 10:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with identifier: RT89872
2026-03-29 10:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with identifier: RT89872
2026-03-29 10:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 997a9cd7-3c22-5867-8c2d-9de0f5f61a43 with identifier: RT89872 to the API
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT89872>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:34:58Z',
'fuel_type': 'petrol',
'id': '997a9cd7-3c22-5867-8c2d-9de0f5f61a43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT89872',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 48410,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_30a67c8329f476dc336dd254616993d0.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_ff783b9cd229becc40fa7d5a5cef23af.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_e106263665021b1640b0c2f4ed5536aa.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_0c07c2add9627aab78521c2120200696.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_f6800e2bad877b845601ba79384f3f74.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_ca37ecc5e3787b95a790ba7d38244e55.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_441d409bb6d8b134a86808ac860b3325.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_a46af5c7e84a1f58e01af73f460fc2d4.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_893484cea9293d0163322d64bb5de2bc.jpg',
'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_06c1067675ba0c18537ab12d71bdf007.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_30a67c8329f476dc336dd254616993d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_ff783b9cd229becc40fa7d5a5cef23af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_e106263665021b1640b0c2f4ed5536aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_0c07c2add9627aab78521c2120200696.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_f6800e2bad877b845601ba79384f3f74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_ca37ecc5e3787b95a790ba7d38244e55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_441d409bb6d8b134a86808ac860b3325.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_a46af5c7e84a1f58e01af73f460fc2d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_893484cea9293d0163322d64bb5de2bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997a9cd7-3c22-5867-8c2d-9de0f5f61a43/997a9cd7-3c22-5867-8c2d-9de0f5f61a43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/4d/b34d831ed70044c2dd460010b2d77463/pa/RT89872_06c1067675ba0c18537ab12d71bdf007.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 AMG Line',
'transmission': 'manual',
'trim': 'AMG Line',
'year': 2016}
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT89872%27 HTTP/1.1" 200 None
2026-03-29 10:31:57 [auto1.de] INFO: Saving data for RT89872: {'created_time': 1774780317.836136, 'last_price_update_time': 1774780317.836148, 'auction_closing_time': 1774884898.0}
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT89872') HTTP/1.1" 204 0
2026-03-29 10:32:06 [scrapy.extensions.logstats] INFO: Crawled 32 pages (at 22 pages/min), scraped 91 items (at 77 items/min)
2026-03-29 10:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-29 10:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL28977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL28977> (referer: https://www.auto1.com/v1/car-details-view/ZL28977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e8954a-1784-5c89-a9cc-959036665613 with identifier: ZL28977
2026-03-29 10:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e8954a-1784-5c89-a9cc-959036665613 with scrape type 1
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_79a3413bddbe740fb6b824f929dc1db8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_79a3413bddbe740fb6b824f929dc1db8.jpg not downloaded yet
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_23aced179b36eabe832d94dd555d2617.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_23aced179b36eabe832d94dd555d2617.jpg not downloaded yet
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_9c762538c0f7ddd54839037e57a2a655.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_9c762538c0f7ddd54839037e57a2a655.jpg not downloaded yet
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_3e60bf0e581ab68f4f6bdf86fd99c933.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_3e60bf0e581ab68f4f6bdf86fd99c933.jpg not downloaded yet
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_b6e2c2a0093c45569be3666a6f923816.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_b6e2c2a0093c45569be3666a6f923816.jpg not downloaded yet
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_ae1a8f6323b53358f334b92a1470b768.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_ae1a8f6323b53358f334b92a1470b768.jpg not downloaded yet
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_d283d3a4d10730e8867623d09200962c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_d283d3a4d10730e8867623d09200962c.jpg not downloaded yet
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_79a3413bddbe740fb6b824f929dc1db8.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_51ce433f4574dbfd763880179536dd6b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_51ce433f4574dbfd763880179536dd6b.jpg not downloaded yet
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_8d032cef05f5e6a0367dbfa92608af82.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_8d032cef05f5e6a0367dbfa92608af82.jpg not downloaded yet
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_74f6e0e1e62badb4549d91cf315080cb.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_74f6e0e1e62badb4549d91cf315080cb.jpg not downloaded yet
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE54390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f785d2d92d0>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_0.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_79a3413bddbe740fb6b824f929dc1db8.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_79a3413bddbe740fb6b824f929dc1db8.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_23aced179b36eabe832d94dd555d2617.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_3e60bf0e581ab68f4f6bdf86fd99c933.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_51ce433f4574dbfd763880179536dd6b.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_b6e2c2a0093c45569be3666a6f923816.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_d283d3a4d10730e8867623d09200962c.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856e864d0>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_1.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_23aced179b36eabe832d94dd555d2617.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_23aced179b36eabe832d94dd555d2617.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_9c762538c0f7ddd54839037e57a2a655.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856c402d0>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_3.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_3e60bf0e581ab68f4f6bdf86fd99c933.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_3e60bf0e581ab68f4f6bdf86fd99c933.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_74f6e0e1e62badb4549d91cf315080cb.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856ec9450>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_7.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_51ce433f4574dbfd763880179536dd6b.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_51ce433f4574dbfd763880179536dd6b.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856e1cf50>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_4.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_b6e2c2a0093c45569be3666a6f923816.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_b6e2c2a0093c45569be3666a6f923816.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856c10210>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_6.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_d283d3a4d10730e8867623d09200962c.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_d283d3a4d10730e8867623d09200962c.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_ae1a8f6323b53358f334b92a1470b768.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_8d032cef05f5e6a0367dbfa92608af82.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856ef0090>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_2.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_9c762538c0f7ddd54839037e57a2a655.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_9c762538c0f7ddd54839037e57a2a655.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f785ce45390>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_9.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_74f6e0e1e62badb4549d91cf315080cb.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_74f6e0e1e62badb4549d91cf315080cb.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856d021d0>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_5.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_ae1a8f6323b53358f334b92a1470b768.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_ae1a8f6323b53358f334b92a1470b768.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856e84d90>
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_8.jpg HTTP/1.1" 201 0
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fe1%252F6ce1d79ee2d0cc75a9b8923e63f31934%252Fpa%252FZL28977_8d032cef05f5e6a0367dbfa92608af82.jpg') HTTP/1.1" 204 0
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_8d032cef05f5e6a0367dbfa92608af82.jpg saved to cache
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22e8954a-1784-5c89-a9cc-959036665613
2026-03-29 10:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22e8954a-1784-5c89-a9cc-959036665613, skipping ID generation
2026-03-29 10:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e8954a-1784-5c89-a9cc-959036665613 with scrape type 1
2026-03-29 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22e8954a-1784-5c89-a9cc-959036665613 sending to next pipeline
2026-03-29 10:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22e8954a-1784-5c89-a9cc-959036665613, identifier: ZL28977
2026-03-29 10:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22e8954a-1784-5c89-a9cc-959036665613 with identifier: ZL28977
2026-03-29 10:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22e8954a-1784-5c89-a9cc-959036665613 with identifier: ZL28977
2026-03-29 10:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22e8954a-1784-5c89-a9cc-959036665613 with identifier: ZL28977 to the API
2026-03-29 10:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_8d032cef05f5e6a0367dbfa92608af82.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:29:49Z',
'fuel_type': 'diesel',
'id': '22e8954a-1784-5c89-a9cc-959036665613',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL28977',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 78102,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_79a3413bddbe740fb6b824f929dc1db8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_23aced179b36eabe832d94dd555d2617.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_9c762538c0f7ddd54839037e57a2a655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_3e60bf0e581ab68f4f6bdf86fd99c933.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_b6e2c2a0093c45569be3666a6f923816.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75267,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_ae1a8f6323b53358f334b92a1470b768.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_d283d3a4d10730e8867623d09200962c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_51ce433f4574dbfd763880179536dd6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_8d032cef05f5e6a0367dbfa92608af82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8954a-1784-5c89-a9cc-959036665613/22e8954a-1784-5c89-a9cc-959036665613_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/e1/6ce1d79ee2d0cc75a9b8923e63f31934/pa/ZL28977_74f6e0e1e62badb4549d91cf315080cb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-07-01',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2015}
2026-03-29 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL28977%27 HTTP/1.1" 200 None
2026-03-29 10:32:21 [auto1.de] INFO: Saving data for ZL28977: {'created_time': 1774780341.357981, 'last_price_update_time': 1774780341.357996, 'auction_closing_time': 1774884589.0}
2026-03-29 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL28977') HTTP/1.1" 204 0
2026-03-29 10:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE54390> (referer: https://www.auto1.com/v1/car-details-view/XE54390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d38c57-ef15-5798-9a27-aee8ee156eb0 with identifier: XE54390
2026-03-29 10:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d38c57-ef15-5798-9a27-aee8ee156eb0 with scrape type 1
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41d38c57-ef15-5798-9a27-aee8ee156eb0
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_2bf380bf914404345dd82d4ecb29e3e0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_2bf380bf914404345dd82d4ecb29e3e0.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_3221262d9dfa6b45a51e7ef64327f324.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_3221262d9dfa6b45a51e7ef64327f324.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_6bb517820aba0f1c76683090e28e6b88.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_6bb517820aba0f1c76683090e28e6b88.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_7091f100ec6ce59d1d503f40e7ef49f7.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_7091f100ec6ce59d1d503f40e7ef49f7.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_b9d49a6838eef66fb09859e4e7b2b825.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_b9d49a6838eef66fb09859e4e7b2b825.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_c2c2e46f46333aa7c0aa65297d1648ae.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_c2c2e46f46333aa7c0aa65297d1648ae.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_5c2d7bfba4d272dd270691a2d9f94128.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_5c2d7bfba4d272dd270691a2d9f94128.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_b8b6ddc6a08e0d8b58ef884b1c692855.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_b8b6ddc6a08e0d8b58ef884b1c692855.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_68dc299bfe557539451d000a07083857.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_68dc299bfe557539451d000a07083857.jpg already downloaded
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fe3%252F85e3f15a949b7b73e3d0e779b1fbdeb8%252Fpa%252FXE54390_8d5377cc00d2c9d86cbc1f4d451bae54.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_8d5377cc00d2c9d86cbc1f4d451bae54.jpg already downloaded
2026-03-29 10:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41d38c57-ef15-5798-9a27-aee8ee156eb0, identifier: XE54390
2026-03-29 10:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41d38c57-ef15-5798-9a27-aee8ee156eb0 with identifier: XE54390
2026-03-29 10:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41d38c57-ef15-5798-9a27-aee8ee156eb0 with identifier: XE54390
2026-03-29 10:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41d38c57-ef15-5798-9a27-aee8ee156eb0 with identifier: XE54390 to the API
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XE54390>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:58:41Z',
'fuel_type': 'diesel',
'id': '41d38c57-ef15-5798-9a27-aee8ee156eb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE54390',
'listing': 'auction',
'location': 'DE, Dortmund',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 61125,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_2bf380bf914404345dd82d4ecb29e3e0.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_3221262d9dfa6b45a51e7ef64327f324.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_6bb517820aba0f1c76683090e28e6b88.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_7091f100ec6ce59d1d503f40e7ef49f7.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_b9d49a6838eef66fb09859e4e7b2b825.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_c2c2e46f46333aa7c0aa65297d1648ae.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_5c2d7bfba4d272dd270691a2d9f94128.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_b8b6ddc6a08e0d8b58ef884b1c692855.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_68dc299bfe557539451d000a07083857.jpg',
'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_8d5377cc00d2c9d86cbc1f4d451bae54.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_2bf380bf914404345dd82d4ecb29e3e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_3221262d9dfa6b45a51e7ef64327f324.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_6bb517820aba0f1c76683090e28e6b88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_7091f100ec6ce59d1d503f40e7ef49f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_b9d49a6838eef66fb09859e4e7b2b825.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_c2c2e46f46333aa7c0aa65297d1648ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_5c2d7bfba4d272dd270691a2d9f94128.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_b8b6ddc6a08e0d8b58ef884b1c692855.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_68dc299bfe557539451d000a07083857.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d38c57-ef15-5798-9a27-aee8ee156eb0/41d38c57-ef15-5798-9a27-aee8ee156eb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/e3/85e3f15a949b7b73e3d0e779b1fbdeb8/pa/XE54390_8d5377cc00d2c9d86cbc1f4d451bae54.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-03',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Rip Curl M',
'transmission': 'manual',
'trim': 'Rip Curl M',
'year': 2021}
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE54390%27 HTTP/1.1" 200 None
2026-03-29 10:32:22 [auto1.de] INFO: Saving data for XE54390: {'created_time': 1774780342.728714, 'last_price_update_time': 1774780342.728729, 'auction_closing_time': 1774886321.0}
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE54390') HTTP/1.1" 204 0
2026-03-29 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:23 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 6726 | hits on page: 40
2026-03-29 10:32:23 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-29 10:32:23 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-29 10:32:23 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-29 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN18269%27 HTTP/1.1" 200 None
2026-03-29 10:32:23 [auto1.de] INFO: Scrape type for DN18269: 2
2026-03-29 10:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b7e498-c59d-5c58-988c-8d68195d34cf with identifier: DN18269
2026-03-29 10:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b7e498-c59d-5c58-988c-8d68195d34cf with scrape type 2
2026-03-29 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b7e498-c59d-5c58-988c-8d68195d34cf with scrape type 2
2026-03-29 10:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50b7e498-c59d-5c58-988c-8d68195d34cf, identifier: DN18269
2026-03-29 10:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50b7e498-c59d-5c58-988c-8d68195d34cf with identifier: DN18269
2026-03-29 10:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50b7e498-c59d-5c58-988c-8d68195d34cf with identifier: DN18269
2026-03-29 10:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50b7e498-c59d-5c58-988c-8d68195d34cf with identifier: DN18269 to the API
2026-03-29 10:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:36:44Z',
'fuel_type': 'petrol',
'id': '50b7e498-c59d-5c58-988c-8d68195d34cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN18269',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 198838,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-07-30',
'seller_name': None,
'title': 'Fiat Doblo 1.2 SX / Active',
'transmission': 'manual',
'trim': 'SX / Active',
'year': 2001}
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN18269%27 HTTP/1.1" 200 None
2026-03-29 10:32:24 [auto1.de] INFO: Saving data for DN18269: {'auction_closing_time': 1774885004.0, 'created_time': 1773223383.44346, 'last_price_update_time': 1774780344.054724}
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN18269') HTTP/1.1" 204 0
2026-03-29 10:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:24 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49951%27 HTTP/1.1" 200 None
2026-03-29 10:32:24 [auto1.de] INFO: Scrape type for WK49951: 2
2026-03-29 10:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6c4c6e-39a9-506f-99cb-785425ee5845 with identifier: WK49951
2026-03-29 10:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6c4c6e-39a9-506f-99cb-785425ee5845 with scrape type 2
2026-03-29 10:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db6c4c6e-39a9-506f-99cb-785425ee5845 with scrape type 2
2026-03-29 10:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db6c4c6e-39a9-506f-99cb-785425ee5845, identifier: WK49951
2026-03-29 10:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db6c4c6e-39a9-506f-99cb-785425ee5845 with identifier: WK49951
2026-03-29 10:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db6c4c6e-39a9-506f-99cb-785425ee5845 with identifier: WK49951
2026-03-29 10:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db6c4c6e-39a9-506f-99cb-785425ee5845 with identifier: WK49951 to the API
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:55:06Z',
'fuel_type': 'petrol',
'id': 'db6c4c6e-39a9-506f-99cb-785425ee5845',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK49951',
'listing': 'auction',
'make': 'Audi',
'model': '80',
'odometer': 221941,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1994-06-30',
'seller_name': None,
'title': 'Audi 80 2.0 Europa',
'transmission': 'manual',
'trim': 'Europa',
'year': 1994}
2026-03-29 10:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49951%27 HTTP/1.1" 200 None
2026-03-29 10:32:25 [auto1.de] INFO: Saving data for WK49951: {'auction_closing_time': 1774886106.0, 'created_time': 1773467435.756708, 'last_price_update_time': 1774780345.001863}
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK49951') HTTP/1.1" 204 0
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG95875%27 HTTP/1.1" 200 None
2026-03-29 10:32:25 [auto1.de] INFO: Scrape type for HG95875: 2
2026-03-29 10:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef731d2e-d55c-55e5-816e-1d3db61db52a with identifier: HG95875
2026-03-29 10:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef731d2e-d55c-55e5-816e-1d3db61db52a with scrape type 2
2026-03-29 10:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef731d2e-d55c-55e5-816e-1d3db61db52a with scrape type 2
2026-03-29 10:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef731d2e-d55c-55e5-816e-1d3db61db52a, identifier: HG95875
2026-03-29 10:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef731d2e-d55c-55e5-816e-1d3db61db52a with identifier: HG95875
2026-03-29 10:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef731d2e-d55c-55e5-816e-1d3db61db52a with identifier: HG95875
2026-03-29 10:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef731d2e-d55c-55e5-816e-1d3db61db52a with identifier: HG95875 to the API
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:38:08Z',
'fuel_type': 'diesel',
'id': 'ef731d2e-d55c-55e5-816e-1d3db61db52a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG95875',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 232954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-07-31',
'seller_name': None,
'title': 'Audi A3 2.0 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2003}
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG95875%27 HTTP/1.1" 200 None
2026-03-29 10:32:25 [auto1.de] INFO: Saving data for HG95875: {'auction_closing_time': 1774885088.0, 'created_time': 1773687788.678875, 'last_price_update_time': 1774780345.449}
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG95875') HTTP/1.1" 204 0
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-29 10:32:25 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-29 10:32:25 [auto1.de] INFO: Scrape type for WM17924: 2
2026-03-29 10:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0311e399-bbd7-5184-b17a-fa4188f5f81e with identifier: WM17924
2026-03-29 10:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0311e399-bbd7-5184-b17a-fa4188f5f81e with scrape type 2
2026-03-29 10:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0311e399-bbd7-5184-b17a-fa4188f5f81e with scrape type 2
2026-03-29 10:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0311e399-bbd7-5184-b17a-fa4188f5f81e, identifier: WM17924
2026-03-29 10:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0311e399-bbd7-5184-b17a-fa4188f5f81e with identifier: WM17924
2026-03-29 10:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0311e399-bbd7-5184-b17a-fa4188f5f81e with identifier: WM17924
2026-03-29 10:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0311e399-bbd7-5184-b17a-fa4188f5f81e with identifier: WM17924 to the API
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:30:28Z',
'fuel_type': 'diesel',
'id': '0311e399-bbd7-5184-b17a-fa4188f5f81e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM17924',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 319000,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-26',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2004}
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-29 10:32:26 [auto1.de] INFO: Saving data for WM17924: {'auction_closing_time': 1774884628.0, 'created_time': 1774380293.983748, 'last_price_update_time': 1774780346.031702}
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM17924') HTTP/1.1" 204 0
2026-03-29 10:32:26 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV54413%27 HTTP/1.1" 200 None
2026-03-29 10:32:26 [auto1.de] INFO: Scrape type for SV54413: 2
2026-03-29 10:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd312fa-fbed-5a92-8a8c-864261663642 with identifier: SV54413
2026-03-29 10:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd312fa-fbed-5a92-8a8c-864261663642 with scrape type 2
2026-03-29 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd312fa-fbed-5a92-8a8c-864261663642 with scrape type 2
2026-03-29 10:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd312fa-fbed-5a92-8a8c-864261663642, identifier: SV54413
2026-03-29 10:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd312fa-fbed-5a92-8a8c-864261663642 with identifier: SV54413
2026-03-29 10:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd312fa-fbed-5a92-8a8c-864261663642 with identifier: SV54413
2026-03-29 10:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd312fa-fbed-5a92-8a8c-864261663642 with identifier: SV54413 to the API
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:46:19Z',
'fuel_type': 'diesel',
'id': '9dd312fa-fbed-5a92-8a8c-864261663642',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV54413',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 269096,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-22',
'seller_name': None,
'title': 'Audi A4 2.0 TDI S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2013}
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV54413%27 HTTP/1.1" 200 None
2026-03-29 10:32:26 [auto1.de] INFO: Saving data for SV54413: {'auction_closing_time': 1774885579.0, 'created_time': 1773858669.080181, 'last_price_update_time': 1774780346.481203}
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV54413') HTTP/1.1" 204 0
2026-03-29 10:32:26 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-29 10:32:26 [auto1.de] INFO: Scrape type for CL13866: 2
2026-03-29 10:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecaaa344-0280-5485-9e62-77e8897416c7 with identifier: CL13866
2026-03-29 10:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecaaa344-0280-5485-9e62-77e8897416c7 with scrape type 2
2026-03-29 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecaaa344-0280-5485-9e62-77e8897416c7 with scrape type 2
2026-03-29 10:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecaaa344-0280-5485-9e62-77e8897416c7, identifier: CL13866
2026-03-29 10:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecaaa344-0280-5485-9e62-77e8897416c7 with identifier: CL13866
2026-03-29 10:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecaaa344-0280-5485-9e62-77e8897416c7 with identifier: CL13866
2026-03-29 10:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecaaa344-0280-5485-9e62-77e8897416c7 with identifier: CL13866 to the API
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:26:18Z',
'fuel_type': 'diesel',
'id': 'ecaaa344-0280-5485-9e62-77e8897416c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL13866',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T4 Caravelle',
'odometer': 359719,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-07-31',
'seller_name': None,
'title': 'Volkswagen T4 Caravelle 2.5 TDI',
'transmission': 'manual',
'trim': '',
'year': 1998}
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-29 10:32:26 [auto1.de] INFO: Saving data for CL13866: {'auction_closing_time': 1774884378.0, 'created_time': 1773340720.120195, 'last_price_update_time': 1774780346.950048}
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL13866') HTTP/1.1" 204 0
2026-03-29 10:32:26 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-29 10:32:26 [auto1.de] INFO: Scrape type for KP55119: 2
2026-03-29 10:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88b94ece-8f38-5faf-a784-29d64f99f29d with identifier: KP55119
2026-03-29 10:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88b94ece-8f38-5faf-a784-29d64f99f29d with scrape type 2
2026-03-29 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88b94ece-8f38-5faf-a784-29d64f99f29d with scrape type 2
2026-03-29 10:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88b94ece-8f38-5faf-a784-29d64f99f29d, identifier: KP55119
2026-03-29 10:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88b94ece-8f38-5faf-a784-29d64f99f29d with identifier: KP55119
2026-03-29 10:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88b94ece-8f38-5faf-a784-29d64f99f29d with identifier: KP55119
2026-03-29 10:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88b94ece-8f38-5faf-a784-29d64f99f29d with identifier: KP55119 to the API
2026-03-29 10:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:17:25Z',
'fuel_type': 'petrol',
'id': '88b94ece-8f38-5faf-a784-29d64f99f29d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP55119',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 227000,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-31',
'seller_name': None,
'title': 'Ford C-Max 1.8 Black Magic',
'transmission': 'manual',
'trim': 'Black Magic',
'year': 2009}
2026-03-29 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-29 10:32:27 [auto1.de] INFO: Saving data for KP55119: {'auction_closing_time': 1774883845.0, 'created_time': 1773774076.843406, 'last_price_update_time': 1774780347.798474}
2026-03-29 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP55119') HTTP/1.1" 204 0
2026-03-29 10:32:27 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-29 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY81957%27 HTTP/1.1" 200 None
2026-03-29 10:32:27 [auto1.de] INFO: Scrape type for BY81957: 2
2026-03-29 10:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6046bece-07cc-5a18-8aa3-b766b43b80e3 with identifier: BY81957
2026-03-29 10:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6046bece-07cc-5a18-8aa3-b766b43b80e3 with scrape type 2
2026-03-29 10:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6046bece-07cc-5a18-8aa3-b766b43b80e3 with scrape type 2
2026-03-29 10:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6046bece-07cc-5a18-8aa3-b766b43b80e3, identifier: BY81957
2026-03-29 10:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6046bece-07cc-5a18-8aa3-b766b43b80e3 with identifier: BY81957
2026-03-29 10:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6046bece-07cc-5a18-8aa3-b766b43b80e3 with identifier: BY81957
2026-03-29 10:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6046bece-07cc-5a18-8aa3-b766b43b80e3 with identifier: BY81957 to the API
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:00:37Z',
'fuel_type': 'petrol',
'id': '6046bece-07cc-5a18-8aa3-b766b43b80e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY81957',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 210641,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-29',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Special',
'transmission': 'manual',
'trim': 'Special',
'year': 2010}
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY81957%27 HTTP/1.1" 200 None
2026-03-29 10:32:28 [auto1.de] INFO: Saving data for BY81957: {'auction_closing_time': 1774882837.0, 'created_time': 1773514124.397656, 'last_price_update_time': 1774780348.282635}
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY81957') HTTP/1.1" 204 0
2026-03-29 10:32:28 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ51378%27 HTTP/1.1" 200 None
2026-03-29 10:32:28 [auto1.de] INFO: Scrape type for NJ51378: 2
2026-03-29 10:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with identifier: NJ51378
2026-03-29 10:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with scrape type 2
2026-03-29 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with scrape type 2
2026-03-29 10:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a, identifier: NJ51378
2026-03-29 10:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF58085> (referer: https://www.auto1.com/v1/car-details-view/FF58085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with identifier: NJ51378
2026-03-29 10:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with identifier: NJ51378
2026-03-29 10:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8f590e7-14ca-5ce5-a5de-c170f49a3e2a with identifier: NJ51378 to the API
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:59:31Z',
'fuel_type': 'petrol',
'id': 'f8f590e7-14ca-5ce5-a5de-c170f49a3e2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ51378',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 26806,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-28',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2019}
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ51378%27 HTTP/1.1" 200 None
2026-03-29 10:32:29 [auto1.de] INFO: Saving data for NJ51378: {'auction_closing_time': 1774886371.0, 'created_time': 1774550572.614944, 'last_price_update_time': 1774780349.057548}
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ51378') HTTP/1.1" 204 0
2026-03-29 10:32:29 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-29 10:32:29 [auto1.de] INFO: Scrape type for CF02627: 0
2026-03-29 10:32:29 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM11182%27 HTTP/1.1" 200 None
2026-03-29 10:32:29 [auto1.de] INFO: Scrape type for DM11182: 2
2026-03-29 10:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edadcf08-fd5b-5a70-809e-49fc23c4ef79 with identifier: DM11182
2026-03-29 10:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edadcf08-fd5b-5a70-809e-49fc23c4ef79 with scrape type 2
2026-03-29 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edadcf08-fd5b-5a70-809e-49fc23c4ef79 with scrape type 2
2026-03-29 10:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edadcf08-fd5b-5a70-809e-49fc23c4ef79, identifier: DM11182
2026-03-29 10:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edadcf08-fd5b-5a70-809e-49fc23c4ef79 with identifier: DM11182
2026-03-29 10:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edadcf08-fd5b-5a70-809e-49fc23c4ef79 with identifier: DM11182
2026-03-29 10:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edadcf08-fd5b-5a70-809e-49fc23c4ef79 with identifier: DM11182 to the API
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:47:58Z',
'fuel_type': 'diesel',
'id': 'edadcf08-fd5b-5a70-809e-49fc23c4ef79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM11182',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 122515,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-04',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
'transmission': 'manual',
'trim': 'Business Edition BlueMotion',
'year': 2014}
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM11182%27 HTTP/1.1" 200 None
2026-03-29 10:32:29 [auto1.de] INFO: Saving data for DM11182: {'auction_closing_time': 1774885678.0, 'created_time': 1774034480.916487, 'last_price_update_time': 1774780349.648059}
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM11182') HTTP/1.1" 204 0
2026-03-29 10:32:29 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-29 10:32:29 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-29 10:32:29 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX39495%27 HTTP/1.1" 200 None
2026-03-29 10:32:29 [auto1.de] INFO: Scrape type for EX39495: 2
2026-03-29 10:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74259a90-4764-5631-94fa-9f8be044f2e1 with identifier: EX39495
2026-03-29 10:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74259a90-4764-5631-94fa-9f8be044f2e1 with scrape type 2
2026-03-29 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74259a90-4764-5631-94fa-9f8be044f2e1 with scrape type 2
2026-03-29 10:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74259a90-4764-5631-94fa-9f8be044f2e1, identifier: EX39495
2026-03-29 10:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74259a90-4764-5631-94fa-9f8be044f2e1 with identifier: EX39495
2026-03-29 10:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74259a90-4764-5631-94fa-9f8be044f2e1 with identifier: EX39495
2026-03-29 10:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74259a90-4764-5631-94fa-9f8be044f2e1 with identifier: EX39495 to the API
2026-03-29 10:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:39:16Z',
'fuel_type': 'petrol',
'id': '74259a90-4764-5631-94fa-9f8be044f2e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX39495',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 71116,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-30',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 250 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-29 10:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX39495%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [auto1.de] INFO: Saving data for EX39495: {'auction_closing_time': 1774885156.0, 'created_time': 1773945785.676316, 'last_price_update_time': 1774780351.006411}
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX39495') HTTP/1.1" 204 0
2026-03-29 10:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2937853-fce6-5b63-9812-53652face763 with identifier: FF58085
2026-03-29 10:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2937853-fce6-5b63-9812-53652face763 with scrape type 1
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2937853-fce6-5b63-9812-53652face763
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_f16431ff18ff6de88eeb4827bfcf4a0b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_f16431ff18ff6de88eeb4827bfcf4a0b.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_30a2348c139808d3880f2bf8a48e389b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_30a2348c139808d3880f2bf8a48e389b.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_63de1a01c51aaa7a1a6e38d388c37285.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_63de1a01c51aaa7a1a6e38d388c37285.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_c42471d90522f7a5b73cce4d2d91ac62.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_c42471d90522f7a5b73cce4d2d91ac62.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_3bf1a82f0688b1b3f0c2d186ed4f110b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_3bf1a82f0688b1b3f0c2d186ed4f110b.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_c3e8e031e62f0bca2a5c6a885dc1f618.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_c3e8e031e62f0bca2a5c6a885dc1f618.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_08cb13fcfd37976627bc1085301b00c4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_08cb13fcfd37976627bc1085301b00c4.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_66d5b74fa553880fa0d5cfa5e49cd941.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_66d5b74fa553880fa0d5cfa5e49cd941.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_fbbdbaaa14fec6249bfa3c9e5d58fb82.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_fbbdbaaa14fec6249bfa3c9e5d58fb82.jpg already downloaded
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fdd%252Ff7dd5aed56e2ecdda6c40d135a14c9b6%252Fpa%252FFF58085_762c7eeb910a522b75b64ec86adf4ccc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_762c7eeb910a522b75b64ec86adf4ccc.jpg already downloaded
2026-03-29 10:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2937853-fce6-5b63-9812-53652face763, identifier: FF58085
2026-03-29 10:32:31 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 6726 | hits on page: 40
2026-03-29 10:32:31 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-29 10:32:31 [auto1.de] INFO: Scrape type for LY60106: 2
2026-03-29 10:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a12bee83-05a9-5136-aaa1-5ed3cba16af2 with identifier: LY60106
2026-03-29 10:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a12bee83-05a9-5136-aaa1-5ed3cba16af2 with scrape type 2
2026-03-29 10:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a12bee83-05a9-5136-aaa1-5ed3cba16af2 with scrape type 2
2026-03-29 10:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a12bee83-05a9-5136-aaa1-5ed3cba16af2, identifier: LY60106
2026-03-29 10:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2937853-fce6-5b63-9812-53652face763 with identifier: FF58085
2026-03-29 10:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2937853-fce6-5b63-9812-53652face763 with identifier: FF58085
2026-03-29 10:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2937853-fce6-5b63-9812-53652face763 with identifier: FF58085 to the API
2026-03-29 10:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FF58085>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:32:25Z',
'fuel_type': 'petrol',
'id': 'b2937853-fce6-5b63-9812-53652face763',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF58085',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'BMW',
'model': 'X1',
'odometer': 40079,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_f16431ff18ff6de88eeb4827bfcf4a0b.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_30a2348c139808d3880f2bf8a48e389b.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_63de1a01c51aaa7a1a6e38d388c37285.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_c42471d90522f7a5b73cce4d2d91ac62.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_3bf1a82f0688b1b3f0c2d186ed4f110b.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_c3e8e031e62f0bca2a5c6a885dc1f618.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_08cb13fcfd37976627bc1085301b00c4.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_66d5b74fa553880fa0d5cfa5e49cd941.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_fbbdbaaa14fec6249bfa3c9e5d58fb82.jpg',
'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_762c7eeb910a522b75b64ec86adf4ccc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_f16431ff18ff6de88eeb4827bfcf4a0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_30a2348c139808d3880f2bf8a48e389b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_63de1a01c51aaa7a1a6e38d388c37285.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_c42471d90522f7a5b73cce4d2d91ac62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_3bf1a82f0688b1b3f0c2d186ed4f110b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_c3e8e031e62f0bca2a5c6a885dc1f618.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_08cb13fcfd37976627bc1085301b00c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_66d5b74fa553880fa0d5cfa5e49cd941.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_fbbdbaaa14fec6249bfa3c9e5d58fb82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2937853-fce6-5b63-9812-53652face763/b2937853-fce6-5b63-9812-53652face763_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/dd/f7dd5aed56e2ecdda6c40d135a14c9b6/pa/FF58085_762c7eeb910a522b75b64ec86adf4ccc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 18i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2020}
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF58085%27 HTTP/1.1" 200 None
2026-03-29 10:32:32 [auto1.de] INFO: Saving data for FF58085: {'created_time': 1774780352.245183, 'last_price_update_time': 1774780352.245193, 'auction_closing_time': 1774884745.0}
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF58085') HTTP/1.1" 204 0
2026-03-29 10:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a12bee83-05a9-5136-aaa1-5ed3cba16af2 with identifier: LY60106
2026-03-29 10:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a12bee83-05a9-5136-aaa1-5ed3cba16af2 with identifier: LY60106
2026-03-29 10:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a12bee83-05a9-5136-aaa1-5ed3cba16af2 with identifier: LY60106 to the API
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:16:56Z',
'fuel_type': 'petrol',
'id': 'a12bee83-05a9-5136-aaa1-5ed3cba16af2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY60106',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 186175,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-27',
'seller_name': None,
'title': 'Opel Meriva 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2008}
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-29 10:32:32 [auto1.de] INFO: Saving data for LY60106: {'auction_closing_time': 1774883816.0, 'created_time': 1773859288.243626, 'last_price_update_time': 1774780352.813322}
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY60106') HTTP/1.1" 204 0
2026-03-29 10:32:32 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-29 10:32:32 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-29 10:32:32 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG12226%27 HTTP/1.1" 200 None
2026-03-29 10:32:32 [auto1.de] INFO: Scrape type for JG12226: 1
2026-03-29 10:32:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:32 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-29 10:32:32 [auto1.de] INFO: Scrape type for GR07934: 2
2026-03-29 10:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56a130e6-1790-5661-b096-f792f32f0a5c with identifier: GR07934
2026-03-29 10:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56a130e6-1790-5661-b096-f792f32f0a5c with scrape type 2
2026-03-29 10:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56a130e6-1790-5661-b096-f792f32f0a5c with scrape type 2
2026-03-29 10:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56a130e6-1790-5661-b096-f792f32f0a5c, identifier: GR07934
2026-03-29 10:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56a130e6-1790-5661-b096-f792f32f0a5c with identifier: GR07934
2026-03-29 10:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56a130e6-1790-5661-b096-f792f32f0a5c with identifier: GR07934
2026-03-29 10:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56a130e6-1790-5661-b096-f792f32f0a5c with identifier: GR07934 to the API
2026-03-29 10:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:33:09Z',
'fuel_type': 'petrol',
'id': '56a130e6-1790-5661-b096-f792f32f0a5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR07934',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 109336,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-03-01',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 1999}
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-29 10:32:35 [auto1.de] INFO: Saving data for GR07934: {'auction_closing_time': 1774884789.0, 'created_time': 1773946388.21688, 'last_price_update_time': 1774780355.050644}
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR07934') HTTP/1.1" 204 0
2026-03-29 10:32:35 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-29 10:32:35 [auto1.de] INFO: Scrape type for UV43425: 2
2026-03-29 10:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87546774-0f03-5143-ab20-41177e28254e with identifier: UV43425
2026-03-29 10:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87546774-0f03-5143-ab20-41177e28254e with scrape type 2
2026-03-29 10:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87546774-0f03-5143-ab20-41177e28254e with scrape type 2
2026-03-29 10:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87546774-0f03-5143-ab20-41177e28254e, identifier: UV43425
2026-03-29 10:32:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:35 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-29 10:32:35 [auto1.de] INFO: Scrape type for GZ84157: 2
2026-03-29 10:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with identifier: GZ84157
2026-03-29 10:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with scrape type 2
2026-03-29 10:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with scrape type 2
2026-03-29 10:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd, identifier: GZ84157
2026-03-29 10:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87546774-0f03-5143-ab20-41177e28254e with identifier: UV43425
2026-03-29 10:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87546774-0f03-5143-ab20-41177e28254e with identifier: UV43425
2026-03-29 10:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87546774-0f03-5143-ab20-41177e28254e with identifier: UV43425 to the API
2026-03-29 10:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:03:42Z',
'fuel_type': 'diesel',
'id': '87546774-0f03-5143-ab20-41177e28254e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV43425',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 170566,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-03',
'seller_name': None,
'title': 'BMW 5er 525d',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 10:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-29 10:32:36 [auto1.de] INFO: Saving data for UV43425: {'auction_closing_time': 1774883022.0, 'created_time': 1773484480.694818, 'last_price_update_time': 1774780356.978755}
2026-03-29 10:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV43425') HTTP/1.1" 204 0
2026-03-29 10:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with identifier: GZ84157
2026-03-29 10:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with identifier: GZ84157
2026-03-29 10:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6040ccd-0b52-59fe-aa87-2e2c054d5fdd with identifier: GZ84157 to the API
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:27:22Z',
'fuel_type': 'petrol',
'id': 'b6040ccd-0b52-59fe-aa87-2e2c054d5fdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ84157',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 189594,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-09-26',
'seller_name': None,
'title': 'Skoda Fabia 2.0 Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2006}
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-29 10:32:37 [auto1.de] INFO: Saving data for GZ84157: {'auction_closing_time': 1774884442.0, 'created_time': 1774637096.804937, 'last_price_update_time': 1774780357.405405}
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ84157') HTTP/1.1" 204 0
2026-03-29 10:32:37 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-29 10:32:37 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-29 10:32:37 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-29 10:32:37 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09643%27 HTTP/1.1" 200 None
2026-03-29 10:32:37 [auto1.de] INFO: Scrape type for CZ09643: 2
2026-03-29 10:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with identifier: CZ09643
2026-03-29 10:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with scrape type 2
2026-03-29 10:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with scrape type 2
2026-03-29 10:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed, identifier: CZ09643
2026-03-29 10:32:37 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-29 10:32:37 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF75132%27 HTTP/1.1" 200 None
2026-03-29 10:32:37 [auto1.de] INFO: Scrape type for UF75132: 2
2026-03-29 10:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with identifier: UF75132
2026-03-29 10:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with scrape type 2
2026-03-29 10:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with scrape type 2
2026-03-29 10:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f, identifier: UF75132
2026-03-29 10:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with identifier: CZ09643
2026-03-29 10:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with identifier: CZ09643
2026-03-29 10:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed with identifier: CZ09643 to the API
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:50:20Z',
'fuel_type': 'petrol',
'id': '100b65d2-7a2c-5e9c-a8f4-e1259ea6c4ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ09643',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 152024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-31',
'seller_name': None,
'title': 'Ford Ka 1.2 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09643%27 HTTP/1.1" 200 None
2026-03-29 10:32:37 [auto1.de] INFO: Saving data for CZ09643: {'auction_closing_time': 1774885820.0, 'created_time': 1774550464.243105, 'last_price_update_time': 1774780357.964946}
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ09643') HTTP/1.1" 204 0
2026-03-29 10:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with identifier: UF75132
2026-03-29 10:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with identifier: UF75132
2026-03-29 10:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71eb8b6b-984d-5bd1-97d0-7ef283a0f69f with identifier: UF75132 to the API
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:50:10Z',
'fuel_type': 'petrol',
'id': '71eb8b6b-984d-5bd1-97d0-7ef283a0f69f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF75132',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 139751,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-15',
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Fun X',
'transmission': 'manual',
'trim': 'Fun X',
'year': 2006}
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF75132%27 HTTP/1.1" 200 None
2026-03-29 10:32:38 [auto1.de] INFO: Saving data for UF75132: {'auction_closing_time': 1774885810.0, 'created_time': 1773306398.576015, 'last_price_update_time': 1774780358.318921}
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF75132') HTTP/1.1" 204 0
2026-03-29 10:32:38 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ98247%27 HTTP/1.1" 200 None
2026-03-29 10:32:38 [auto1.de] INFO: Scrape type for LZ98247: 1
2026-03-29 10:32:38 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-29 10:32:38 [auto1.de] INFO: Scrape type for FR75533: 2
2026-03-29 10:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e4491c1-43a1-51c8-985e-bad3501861f5 with identifier: FR75533
2026-03-29 10:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e4491c1-43a1-51c8-985e-bad3501861f5 with scrape type 2
2026-03-29 10:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e4491c1-43a1-51c8-985e-bad3501861f5 with scrape type 2
2026-03-29 10:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e4491c1-43a1-51c8-985e-bad3501861f5, identifier: FR75533
2026-03-29 10:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e4491c1-43a1-51c8-985e-bad3501861f5 with identifier: FR75533
2026-03-29 10:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e4491c1-43a1-51c8-985e-bad3501861f5 with identifier: FR75533
2026-03-29 10:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e4491c1-43a1-51c8-985e-bad3501861f5 with identifier: FR75533 to the API
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:17:30Z',
'fuel_type': 'diesel',
'id': '5e4491c1-43a1-51c8-985e-bad3501861f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR75533',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 145792,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-02',
'seller_name': None,
'title': 'Ford S-Max 2.2 TDCi Titanium S',
'transmission': 'manual',
'trim': 'Titanium S',
'year': 2010}
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-29 10:32:38 [auto1.de] INFO: Saving data for FR75533: {'auction_closing_time': 1774883850.0, 'created_time': 1773859584.884356, 'last_price_update_time': 1774780358.794271}
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR75533') HTTP/1.1" 204 0
2026-03-29 10:32:38 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM39350%27 HTTP/1.1" 200 None
2026-03-29 10:32:38 [auto1.de] INFO: Scrape type for VM39350: 2
2026-03-29 10:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9fb4031-0c14-518a-8eaa-ff203f466792 with identifier: VM39350
2026-03-29 10:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9fb4031-0c14-518a-8eaa-ff203f466792 with scrape type 2
2026-03-29 10:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9fb4031-0c14-518a-8eaa-ff203f466792 with scrape type 2
2026-03-29 10:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9fb4031-0c14-518a-8eaa-ff203f466792, identifier: VM39350
2026-03-29 10:32:38 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-29 10:32:38 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-29 10:32:38 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-29 10:32:38 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-29 10:32:38 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK64818%27 HTTP/1.1" 200 None
2026-03-29 10:32:38 [auto1.de] INFO: Scrape type for EK64818: 2
2026-03-29 10:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0069dbb-e730-5952-b580-a3fc1a066838 with identifier: EK64818
2026-03-29 10:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0069dbb-e730-5952-b580-a3fc1a066838 with scrape type 2
2026-03-29 10:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0069dbb-e730-5952-b580-a3fc1a066838 with scrape type 2
2026-03-29 10:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0069dbb-e730-5952-b580-a3fc1a066838, identifier: EK64818
2026-03-29 10:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9fb4031-0c14-518a-8eaa-ff203f466792 with identifier: VM39350
2026-03-29 10:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9fb4031-0c14-518a-8eaa-ff203f466792 with identifier: VM39350
2026-03-29 10:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9fb4031-0c14-518a-8eaa-ff203f466792 with identifier: VM39350 to the API
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:26:22Z',
'fuel_type': 'diesel',
'id': 'f9fb4031-0c14-518a-8eaa-ff203f466792',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM39350',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 267329,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-03-30',
'seller_name': None,
'title': 'Ford Galaxy 1.9 TDI Ghia',
'transmission': 'automatic',
'trim': 'Ghia',
'year': 2003}
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM39350%27 HTTP/1.1" 200 None
2026-03-29 10:32:39 [auto1.de] INFO: Saving data for VM39350: {'auction_closing_time': 1774884382.0, 'created_time': 1773659900.49941, 'last_price_update_time': 1774780359.336133}
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM39350') HTTP/1.1" 204 0
2026-03-29 10:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0069dbb-e730-5952-b580-a3fc1a066838 with identifier: EK64818
2026-03-29 10:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0069dbb-e730-5952-b580-a3fc1a066838 with identifier: EK64818
2026-03-29 10:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0069dbb-e730-5952-b580-a3fc1a066838 with identifier: EK64818 to the API
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:09:45Z',
'fuel_type': 'petrol',
'id': 'f0069dbb-e730-5952-b580-a3fc1a066838',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK64818',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 164156,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1995-01-31',
'seller_name': None,
'title': 'Audi A4 1.8',
'transmission': 'manual',
'trim': '',
'year': 1995}
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK64818%27 HTTP/1.1" 200 None
2026-03-29 10:32:39 [auto1.de] INFO: Saving data for EK64818: {'auction_closing_time': 1774883385.0, 'created_time': 1773304981.598212, 'last_price_update_time': 1774780359.769633}
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK64818') HTTP/1.1" 204 0
2026-03-29 10:32:39 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-29 10:32:39 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-29 10:32:39 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-29 10:32:39 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-29 10:32:39 [auto1.de] INFO: Scrape type for LV79824: 2
2026-03-29 10:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9aa10cd-8550-5136-829c-59b7f49e1288 with identifier: LV79824
2026-03-29 10:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9aa10cd-8550-5136-829c-59b7f49e1288 with scrape type 2
2026-03-29 10:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9aa10cd-8550-5136-829c-59b7f49e1288 with scrape type 2
2026-03-29 10:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9aa10cd-8550-5136-829c-59b7f49e1288, identifier: LV79824
2026-03-29 10:32:39 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-29 10:32:39 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-29 10:32:39 [auto1.de] INFO: Scrape type for AT28488: 2
2026-03-29 10:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with identifier: AT28488
2026-03-29 10:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with scrape type 2
2026-03-29 10:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with scrape type 2
2026-03-29 10:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef, identifier: AT28488
2026-03-29 10:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9aa10cd-8550-5136-829c-59b7f49e1288 with identifier: LV79824
2026-03-29 10:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9aa10cd-8550-5136-829c-59b7f49e1288 with identifier: LV79824
2026-03-29 10:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9aa10cd-8550-5136-829c-59b7f49e1288 with identifier: LV79824 to the API
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 203,
'expiration_date': '2026-03-30T15:04:58Z',
'fuel_type': 'petrol',
'id': 'e9aa10cd-8550-5136-829c-59b7f49e1288',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV79824',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 176736,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-29',
'seller_name': None,
'title': 'Ford S-Max 2.0 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2012}
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-29 10:32:40 [auto1.de] INFO: Saving data for LV79824: {'auction_closing_time': 1774883098.0, 'created_time': 1773513754.442755, 'last_price_update_time': 1774780360.354514}
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV79824') HTTP/1.1" 204 0
2026-03-29 10:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with identifier: AT28488
2026-03-29 10:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with identifier: AT28488
2026-03-29 10:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef with identifier: AT28488 to the API
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:00:10Z',
'fuel_type': 'petrol',
'id': '2c8f6ea9-45e1-56ad-969e-f7c2e51da5ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT28488',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 227662,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-07-06',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2003}
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-29 10:32:40 [auto1.de] INFO: Saving data for AT28488: {'auction_closing_time': 1774882810.0, 'created_time': 1773945106.90588, 'last_price_update_time': 1774780360.70264}
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT28488') HTTP/1.1" 204 0
2026-03-29 10:32:40 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-29 10:32:40 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-29 10:32:40 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-29 10:32:40 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-29 10:32:40 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-29 10:32:40 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-29 10:32:40 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-29 10:32:40 [auto1.de] INFO: Scrape type for TX49680: 2
2026-03-29 10:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with identifier: TX49680
2026-03-29 10:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with scrape type 2
2026-03-29 10:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with scrape type 2
2026-03-29 10:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00ed8e81-467e-5d46-a16f-6ccdc256ee81, identifier: TX49680
2026-03-29 10:32:40 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW90897%27 HTTP/1.1" 200 None
2026-03-29 10:32:40 [auto1.de] INFO: Scrape type for YW90897: 2
2026-03-29 10:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145d86d8-4667-50d9-941d-0c8684d27b54 with identifier: YW90897
2026-03-29 10:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145d86d8-4667-50d9-941d-0c8684d27b54 with scrape type 2
2026-03-29 10:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 145d86d8-4667-50d9-941d-0c8684d27b54 with scrape type 2
2026-03-29 10:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 145d86d8-4667-50d9-941d-0c8684d27b54, identifier: YW90897
2026-03-29 10:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with identifier: TX49680
2026-03-29 10:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with identifier: TX49680
2026-03-29 10:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00ed8e81-467e-5d46-a16f-6ccdc256ee81 with identifier: TX49680 to the API
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:22:16Z',
'fuel_type': 'petrol',
'id': '00ed8e81-467e-5d46-a16f-6ccdc256ee81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX49680',
'listing': 'auction',
'make': 'Honda',
'model': 'Logo',
'odometer': 113882,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-09-06',
'seller_name': None,
'title': 'Honda Logo 1.3',
'transmission': 'automatic',
'trim': '',
'year': 2001}
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-29 10:32:41 [auto1.de] INFO: Saving data for TX49680: {'auction_closing_time': 1774884136.0, 'created_time': 1774637097.145163, 'last_price_update_time': 1774780361.267984}
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX49680') HTTP/1.1" 204 0
2026-03-29 10:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 145d86d8-4667-50d9-941d-0c8684d27b54 with identifier: YW90897
2026-03-29 10:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 145d86d8-4667-50d9-941d-0c8684d27b54 with identifier: YW90897
2026-03-29 10:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 145d86d8-4667-50d9-941d-0c8684d27b54 with identifier: YW90897 to the API
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:34:06Z',
'fuel_type': 'diesel',
'id': '145d86d8-4667-50d9-941d-0c8684d27b54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW90897',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 144247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-02',
'seller_name': None,
'title': 'Ford C-Max 1.5 TDCi Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2017}
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW90897%27 HTTP/1.1" 200 None
2026-03-29 10:32:41 [auto1.de] INFO: Saving data for YW90897: {'auction_closing_time': 1774884846.0, 'created_time': 1773774124.575772, 'last_price_update_time': 1774780361.716408}
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW90897') HTTP/1.1" 204 0
2026-03-29 10:32:41 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-29 10:32:41 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-29 10:32:41 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-29 10:32:41 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79047%27 HTTP/1.1" 200 None
2026-03-29 10:32:41 [auto1.de] INFO: Scrape type for MW79047: 2
2026-03-29 10:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de92135d-4e25-5cbb-9e93-dcc36ca0c173 with identifier: MW79047
2026-03-29 10:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de92135d-4e25-5cbb-9e93-dcc36ca0c173 with scrape type 2
2026-03-29 10:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de92135d-4e25-5cbb-9e93-dcc36ca0c173 with scrape type 2
2026-03-29 10:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de92135d-4e25-5cbb-9e93-dcc36ca0c173, identifier: MW79047
2026-03-29 10:32:42 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-29 10:32:42 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-29 10:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de92135d-4e25-5cbb-9e93-dcc36ca0c173 with identifier: MW79047
2026-03-29 10:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de92135d-4e25-5cbb-9e93-dcc36ca0c173 with identifier: MW79047
2026-03-29 10:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de92135d-4e25-5cbb-9e93-dcc36ca0c173 with identifier: MW79047 to the API
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:08:49Z',
'fuel_type': 'petrol',
'id': 'de92135d-4e25-5cbb-9e93-dcc36ca0c173',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW79047',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 280120,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-03-18',
'seller_name': None,
'title': 'Audi A6 2.4 V6',
'transmission': 'manual',
'trim': '',
'year': 1999}
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79047%27 HTTP/1.1" 200 None
2026-03-29 10:32:42 [auto1.de] INFO: Saving data for MW79047: {'auction_closing_time': 1774883329.0, 'created_time': 1773306551.653402, 'last_price_update_time': 1774780362.444818}
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW79047') HTTP/1.1" 204 0
2026-03-29 10:32:42 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-29 10:32:42 [auto1.de] INFO: Scrape type for RP29277: 2
2026-03-29 10:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with identifier: RP29277
2026-03-29 10:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with scrape type 2
2026-03-29 10:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with scrape type 2
2026-03-29 10:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94, identifier: RP29277
2026-03-29 10:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with identifier: RP29277
2026-03-29 10:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with identifier: RP29277
2026-03-29 10:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 841f404c-c1f6-5fcc-af9f-d8cb7d739b94 with identifier: RP29277 to the API
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:11:40Z',
'fuel_type': 'petrol',
'id': '841f404c-c1f6-5fcc-af9f-d8cb7d739b94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP29277',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 277668,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-10',
'seller_name': None,
'title': 'Ford S-Max 2.0 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2006}
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-29 10:32:42 [auto1.de] INFO: Saving data for RP29277: {'auction_closing_time': 1774883500.0, 'created_time': 1773513721.393587, 'last_price_update_time': 1774780362.893244}
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP29277') HTTP/1.1" 204 0
2026-03-29 10:32:42 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-29 10:32:42 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-29 10:32:42 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ47065%27 HTTP/1.1" 200 None
2026-03-29 10:32:42 [auto1.de] INFO: Scrape type for CZ47065: 1
2026-03-29 10:32:42 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX94865%27 HTTP/1.1" 200 None
2026-03-29 10:32:42 [auto1.de] INFO: Scrape type for VX94865: 2
2026-03-29 10:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f9a288b-4c05-5450-8957-b85332c627c5 with identifier: VX94865
2026-03-29 10:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f9a288b-4c05-5450-8957-b85332c627c5 with scrape type 2
2026-03-29 10:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f9a288b-4c05-5450-8957-b85332c627c5 with scrape type 2
2026-03-29 10:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f9a288b-4c05-5450-8957-b85332c627c5, identifier: VX94865
2026-03-29 10:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f9a288b-4c05-5450-8957-b85332c627c5 with identifier: VX94865
2026-03-29 10:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f9a288b-4c05-5450-8957-b85332c627c5 with identifier: VX94865
2026-03-29 10:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f9a288b-4c05-5450-8957-b85332c627c5 with identifier: VX94865 to the API
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:45:45Z',
'fuel_type': 'diesel',
'id': '2f9a288b-4c05-5450-8957-b85332c627c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX94865',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Grand Sport',
'odometer': 97181,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-16',
'seller_name': None,
'title': 'Opel Insignia Grand Sport 2.0 CDTI GSi 4x4',
'transmission': 'automatic',
'trim': 'GSi 4x4',
'year': 2019}
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX94865%27 HTTP/1.1" 200 None
2026-03-29 10:32:43 [auto1.de] INFO: Saving data for VX94865: {'auction_closing_time': 1774885545.0, 'created_time': 1774550712.046786, 'last_price_update_time': 1774780363.360114}
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX94865') HTTP/1.1" 204 0
2026-03-29 10:32:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:43 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-29 10:32:43 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE08723%27 HTTP/1.1" 200 None
2026-03-29 10:32:43 [auto1.de] INFO: Scrape type for XE08723: 2
2026-03-29 10:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with identifier: XE08723
2026-03-29 10:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with scrape type 2
2026-03-29 10:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with scrape type 2
2026-03-29 10:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15, identifier: XE08723
2026-03-29 10:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with identifier: XE08723
2026-03-29 10:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with identifier: XE08723
2026-03-29 10:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43cad7e5-24bc-52ad-a419-c44ed5ac8a15 with identifier: XE08723 to the API
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:15:13Z',
'fuel_type': 'petrol',
'id': '43cad7e5-24bc-52ad-a419-c44ed5ac8a15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE08723',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 58428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-06-02',
'seller_name': None,
'title': 'Audi A4 2.4 V6',
'transmission': 'automatic',
'trim': '',
'year': 2002}
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE08723%27 HTTP/1.1" 200 None
2026-03-29 10:32:43 [auto1.de] INFO: Saving data for XE08723: {'auction_closing_time': 1774883713.0, 'created_time': 1774550544.546173, 'last_price_update_time': 1774780363.902506}
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE08723') HTTP/1.1" 204 0
2026-03-29 10:32:43 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU50389%27 HTTP/1.1" 200 None
2026-03-29 10:32:43 [auto1.de] INFO: Scrape type for AU50389: 2
2026-03-29 10:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11368bb7-774b-5ef1-8b00-99ec34f0b388 with identifier: AU50389
2026-03-29 10:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11368bb7-774b-5ef1-8b00-99ec34f0b388 with scrape type 2
2026-03-29 10:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11368bb7-774b-5ef1-8b00-99ec34f0b388 with scrape type 2
2026-03-29 10:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11368bb7-774b-5ef1-8b00-99ec34f0b388, identifier: AU50389
2026-03-29 10:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11368bb7-774b-5ef1-8b00-99ec34f0b388 with identifier: AU50389
2026-03-29 10:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11368bb7-774b-5ef1-8b00-99ec34f0b388 with identifier: AU50389
2026-03-29 10:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11368bb7-774b-5ef1-8b00-99ec34f0b388 with identifier: AU50389 to the API
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:28:34Z',
'fuel_type': 'diesel',
'id': '11368bb7-774b-5ef1-8b00-99ec34f0b388',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU50389',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 192385,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-27',
'seller_name': None,
'title': 'Ford Transit 2.2 TDCi FT 280 K',
'transmission': 'manual',
'trim': 'FT 280 K',
'year': 2006}
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU50389%27 HTTP/1.1" 200 None
2026-03-29 10:32:44 [auto1.de] INFO: Saving data for AU50389: {'auction_closing_time': 1774884514.0, 'created_time': 1773301832.732149, 'last_price_update_time': 1774780364.378124}
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU50389') HTTP/1.1" 204 0
2026-03-29 10:32:44 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-29 10:32:44 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-29 10:32:44 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-29 10:32:44 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ28184%27 HTTP/1.1" 200 None
2026-03-29 10:32:44 [auto1.de] INFO: Scrape type for KJ28184: 1
2026-03-29 10:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ98247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG12226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:44 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-29 10:32:44 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT98357%27 HTTP/1.1" 200 None
2026-03-29 10:32:44 [auto1.de] INFO: Scrape type for UT98357: 2
2026-03-29 10:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd02a1c-831e-5939-9288-cc03839c06bd with identifier: UT98357
2026-03-29 10:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd02a1c-831e-5939-9288-cc03839c06bd with scrape type 2
2026-03-29 10:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd02a1c-831e-5939-9288-cc03839c06bd with scrape type 2
2026-03-29 10:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fd02a1c-831e-5939-9288-cc03839c06bd, identifier: UT98357
2026-03-29 10:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fd02a1c-831e-5939-9288-cc03839c06bd with identifier: UT98357
2026-03-29 10:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fd02a1c-831e-5939-9288-cc03839c06bd with identifier: UT98357
2026-03-29 10:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fd02a1c-831e-5939-9288-cc03839c06bd with identifier: UT98357 to the API
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:09:37Z',
'fuel_type': 'diesel',
'id': '4fd02a1c-831e-5939-9288-cc03839c06bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT98357',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 160046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-10',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2017}
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT98357%27 HTTP/1.1" 200 None
2026-03-29 10:32:44 [auto1.de] INFO: Saving data for UT98357: {'auction_closing_time': 1774883377.0, 'created_time': 1774550622.332565, 'last_price_update_time': 1774780364.864732}
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT98357') HTTP/1.1" 204 0
2026-03-29 10:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:44 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY43469%27 HTTP/1.1" 200 None
2026-03-29 10:32:44 [auto1.de] INFO: Scrape type for HY43469: 2
2026-03-29 10:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with identifier: HY43469
2026-03-29 10:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with scrape type 2
2026-03-29 10:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with scrape type 2
2026-03-29 10:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a, identifier: HY43469
2026-03-29 10:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with identifier: HY43469
2026-03-29 10:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with identifier: HY43469
2026-03-29 10:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13e0d71f-ddb9-578e-bb24-9bf71ef0958a with identifier: HY43469 to the API
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:19:31Z',
'fuel_type': 'petrol',
'id': '13e0d71f-ddb9-578e-bb24-9bf71ef0958a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY43469',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 70905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-29',
'seller_name': None,
'title': "Kia pro_cee'd 1.5 TGDI Mild-Hybrid GT Line",
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2021}
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY43469%27 HTTP/1.1" 200 None
2026-03-29 10:32:45 [auto1.de] INFO: Saving data for HY43469: {'auction_closing_time': 1774883971.0, 'created_time': 1774002406.967266, 'last_price_update_time': 1774780365.322349}
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY43469') HTTP/1.1" 204 0
2026-03-29 10:32:45 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 6726 | hits on page: 40
2026-03-29 10:32:45 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF75867%27 HTTP/1.1" 200 None
2026-03-29 10:32:45 [auto1.de] INFO: Scrape type for KF75867: 1
2026-03-29 10:32:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:45 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA01983%27 HTTP/1.1" 200 None
2026-03-29 10:32:45 [auto1.de] INFO: Scrape type for JA01983: 2
2026-03-29 10:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with identifier: JA01983
2026-03-29 10:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with scrape type 2
2026-03-29 10:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with scrape type 2
2026-03-29 10:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1, identifier: JA01983
2026-03-29 10:32:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with identifier: JA01983
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 10:32:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with identifier: JA01983
2026-03-29 10:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1 with identifier: JA01983 to the API
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:47:23Z',
'fuel_type': 'diesel',
'id': '2ae6cf48-26d8-51e5-b0fc-d3cae369d8a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA01983',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 82631,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-24',
'seller_name': None,
'title': 'Ford Grand C-Max 1.5 TDCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2016}
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA01983%27 HTTP/1.1" 200 None
2026-03-29 10:32:45 [auto1.de] INFO: Saving data for JA01983: {'auction_closing_time': 1774885643.0, 'created_time': 1773513877.814238, 'last_price_update_time': 1774780365.986508}
2026-03-29 10:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA01983') HTTP/1.1" 204 0
2026-03-29 10:32:46 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-29 10:32:46 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH44309%27 HTTP/1.1" 200 None
2026-03-29 10:32:46 [auto1.de] INFO: Scrape type for AH44309: 1
2026-03-29 10:32:46 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99817%27 HTTP/1.1" 200 None
2026-03-29 10:32:46 [auto1.de] INFO: Scrape type for PM99817: 2
2026-03-29 10:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd45caf-e9a8-5465-8ffd-b0c818370c45 with identifier: PM99817
2026-03-29 10:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd45caf-e9a8-5465-8ffd-b0c818370c45 with scrape type 2
2026-03-29 10:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd45caf-e9a8-5465-8ffd-b0c818370c45 with scrape type 2
2026-03-29 10:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffd45caf-e9a8-5465-8ffd-b0c818370c45, identifier: PM99817
2026-03-29 10:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ47065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffd45caf-e9a8-5465-8ffd-b0c818370c45 with identifier: PM99817
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 10:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffd45caf-e9a8-5465-8ffd-b0c818370c45 with identifier: PM99817
2026-03-29 10:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffd45caf-e9a8-5465-8ffd-b0c818370c45 with identifier: PM99817 to the API
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:12:09Z',
'fuel_type': 'diesel',
'id': 'ffd45caf-e9a8-5465-8ffd-b0c818370c45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM99817',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 151152,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-01',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Edition 30 4Motion',
'transmission': 'manual',
'trim': 'Edition 30 4Motion',
'year': 2016}
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99817%27 HTTP/1.1" 200 None
2026-03-29 10:32:46 [auto1.de] INFO: Saving data for PM99817: {'auction_closing_time': 1774883529.0, 'created_time': 1774379144.983357, 'last_price_update_time': 1774780366.737901}
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM99817') HTTP/1.1" 204 0
2026-03-29 10:32:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:46 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-29 10:32:46 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB08314%27 HTTP/1.1" 200 None
2026-03-29 10:32:46 [auto1.de] INFO: Scrape type for DB08314: 2
2026-03-29 10:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with identifier: DB08314
2026-03-29 10:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with scrape type 2
2026-03-29 10:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with scrape type 2
2026-03-29 10:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb36d921-9e76-5b3c-8b21-e9f63a4f5486, identifier: DB08314
2026-03-29 10:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with identifier: DB08314
2026-03-29 10:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with identifier: DB08314
2026-03-29 10:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb36d921-9e76-5b3c-8b21-e9f63a4f5486 with identifier: DB08314 to the API
2026-03-29 10:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:52:04Z',
'fuel_type': 'diesel',
'id': 'fb36d921-9e76-5b3c-8b21-e9f63a4f5486',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB08314',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 108206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-24',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB08314%27 HTTP/1.1" 200 None
2026-03-29 10:32:47 [auto1.de] INFO: Saving data for DB08314: {'auction_closing_time': 1774885924.0, 'created_time': 1774550528.827117, 'last_price_update_time': 1774780367.25407}
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB08314') HTTP/1.1" 204 0
2026-03-29 10:32:47 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-29 10:32:47 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP06637%27 HTTP/1.1" 200 None
2026-03-29 10:32:47 [auto1.de] INFO: Scrape type for DP06637: 2
2026-03-29 10:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d041df-8fbe-5c99-94b9-c304c66f5666 with identifier: DP06637
2026-03-29 10:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d041df-8fbe-5c99-94b9-c304c66f5666 with scrape type 2
2026-03-29 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2d041df-8fbe-5c99-94b9-c304c66f5666 with scrape type 2
2026-03-29 10:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2d041df-8fbe-5c99-94b9-c304c66f5666, identifier: DP06637
2026-03-29 10:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2d041df-8fbe-5c99-94b9-c304c66f5666 with identifier: DP06637
2026-03-29 10:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2d041df-8fbe-5c99-94b9-c304c66f5666 with identifier: DP06637
2026-03-29 10:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2d041df-8fbe-5c99-94b9-c304c66f5666 with identifier: DP06637 to the API
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:36:06Z',
'fuel_type': 'petrol',
'id': 'f2d041df-8fbe-5c99-94b9-c304c66f5666',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP06637',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 202367,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-10-31',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 230 Kompressor',
'transmission': 'automatic',
'trim': '',
'year': 2000}
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP06637%27 HTTP/1.1" 200 None
2026-03-29 10:32:47 [auto1.de] INFO: Saving data for DP06637: {'auction_closing_time': 1774884966.0, 'created_time': 1773341837.397122, 'last_price_update_time': 1774780367.788678}
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP06637') HTTP/1.1" 204 0
2026-03-29 10:32:47 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65344%27 HTTP/1.1" 200 None
2026-03-29 10:32:47 [auto1.de] INFO: Scrape type for NG65344: 2
2026-03-29 10:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with identifier: NG65344
2026-03-29 10:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with scrape type 2
2026-03-29 10:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with scrape type 2
2026-03-29 10:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a, identifier: NG65344
2026-03-29 10:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with identifier: NG65344
2026-03-29 10:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with identifier: NG65344
2026-03-29 10:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5065ac6f-e6a2-5aa8-80f9-d986f059e27a with identifier: NG65344 to the API
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:57:09Z',
'fuel_type': 'diesel',
'id': '5065ac6f-e6a2-5aa8-80f9-d986f059e27a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG65344',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 243392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-02-17',
'seller_name': None,
'title': 'Volkswagen Sharan 1.9 TDI Cruise',
'transmission': 'manual',
'trim': 'Cruise',
'year': 2002}
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65344%27 HTTP/1.1" 200 None
2026-03-29 10:32:48 [auto1.de] INFO: Saving data for NG65344: {'auction_closing_time': 1774886229.0, 'created_time': 1774550670.395776, 'last_price_update_time': 1774780368.252628}
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG65344') HTTP/1.1" 204 0
2026-03-29 10:32:48 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT30705%27 HTTP/1.1" 200 None
2026-03-29 10:32:48 [auto1.de] INFO: Scrape type for XT30705: 1
2026-03-29 10:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:48 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-29 10:32:48 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-29 10:32:48 [auto1.de] INFO: Scrape type for AD00479: 2
2026-03-29 10:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a432d1-522b-51ea-872e-74caaf6ff9b9 with identifier: AD00479
2026-03-29 10:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a432d1-522b-51ea-872e-74caaf6ff9b9 with scrape type 2
2026-03-29 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a432d1-522b-51ea-872e-74caaf6ff9b9 with scrape type 2
2026-03-29 10:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1a432d1-522b-51ea-872e-74caaf6ff9b9, identifier: AD00479
2026-03-29 10:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1a432d1-522b-51ea-872e-74caaf6ff9b9 with identifier: AD00479
2026-03-29 10:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1a432d1-522b-51ea-872e-74caaf6ff9b9 with identifier: AD00479
2026-03-29 10:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1a432d1-522b-51ea-872e-74caaf6ff9b9 with identifier: AD00479 to the API
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:30:06Z',
'fuel_type': 'petrol',
'id': 'f1a432d1-522b-51ea-872e-74caaf6ff9b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD00479',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 190135,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-10-29',
'seller_name': None,
'title': 'Honda Civic 1.4 S 3',
'transmission': 'automatic',
'trim': 'S 3',
'year': 2000}
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-29 10:32:48 [auto1.de] INFO: Saving data for AD00479: {'auction_closing_time': 1774884606.0, 'created_time': 1773916859.225084, 'last_price_update_time': 1774780368.743813}
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD00479') HTTP/1.1" 204 0
2026-03-29 10:32:48 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL69426%27 HTTP/1.1" 200 None
2026-03-29 10:32:48 [auto1.de] INFO: Scrape type for CL69426: 2
2026-03-29 10:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6361aa-de97-59ec-a51e-1b0457cf00df with identifier: CL69426
2026-03-29 10:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6361aa-de97-59ec-a51e-1b0457cf00df with scrape type 2
2026-03-29 10:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de6361aa-de97-59ec-a51e-1b0457cf00df with scrape type 2
2026-03-29 10:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de6361aa-de97-59ec-a51e-1b0457cf00df, identifier: CL69426
2026-03-29 10:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de6361aa-de97-59ec-a51e-1b0457cf00df with identifier: CL69426
2026-03-29 10:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de6361aa-de97-59ec-a51e-1b0457cf00df with identifier: CL69426
2026-03-29 10:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de6361aa-de97-59ec-a51e-1b0457cf00df with identifier: CL69426 to the API
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:02:43Z',
'fuel_type': 'petrol',
'id': 'de6361aa-de97-59ec-a51e-1b0457cf00df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL69426',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 308378,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-30',
'seller_name': None,
'title': 'Ford C-Max 2.0 Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2006}
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL69426%27 HTTP/1.1" 200 None
2026-03-29 10:32:49 [auto1.de] INFO: Saving data for CL69426: {'auction_closing_time': 1774882963.0, 'created_time': 1773830167.159323, 'last_price_update_time': 1774780369.376755}
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL69426') HTTP/1.1" 204 0
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52801%27 HTTP/1.1" 200 None
2026-03-29 10:32:49 [auto1.de] INFO: Scrape type for WJ52801: 2
2026-03-29 10:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with identifier: WJ52801
2026-03-29 10:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with scrape type 2
2026-03-29 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with scrape type 2
2026-03-29 10:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b, identifier: WJ52801
2026-03-29 10:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with identifier: WJ52801
2026-03-29 10:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with identifier: WJ52801
2026-03-29 10:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b with identifier: WJ52801 to the API
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:59:43Z',
'fuel_type': 'diesel',
'id': 'a3b9c9d7-686c-57a0-9a75-dd0674fbbd5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ52801',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 78998,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-29',
'seller_name': None,
'title': 'Citroen C4 1.6 Blue-HDi Business Class',
'transmission': 'manual',
'trim': 'Business Class',
'year': 2016}
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52801%27 HTTP/1.1" 200 None
2026-03-29 10:32:49 [auto1.de] INFO: Saving data for WJ52801: {'auction_closing_time': 1774886383.0, 'created_time': 1773772612.170292, 'last_price_update_time': 1774780369.836814}
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ52801') HTTP/1.1" 204 0
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR43778%27 HTTP/1.1" 200 None
2026-03-29 10:32:49 [auto1.de] INFO: Scrape type for SR43778: 1
2026-03-29 10:32:49 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67741%27 HTTP/1.1" 200 None
2026-03-29 10:32:49 [auto1.de] INFO: Scrape type for GV67741: 2
2026-03-29 10:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1cd6a54-cc4b-5e97-bd8e-833db888b48b with identifier: GV67741
2026-03-29 10:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1cd6a54-cc4b-5e97-bd8e-833db888b48b with scrape type 2
2026-03-29 10:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1cd6a54-cc4b-5e97-bd8e-833db888b48b with scrape type 2
2026-03-29 10:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1cd6a54-cc4b-5e97-bd8e-833db888b48b, identifier: GV67741
2026-03-29 10:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1cd6a54-cc4b-5e97-bd8e-833db888b48b with identifier: GV67741
2026-03-29 10:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1cd6a54-cc4b-5e97-bd8e-833db888b48b with identifier: GV67741
2026-03-29 10:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1cd6a54-cc4b-5e97-bd8e-833db888b48b with identifier: GV67741 to the API
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:13:09Z',
'fuel_type': 'diesel',
'id': 'd1cd6a54-cc4b-5e97-bd8e-833db888b48b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV67741',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 132816,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-21',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Startline',
'transmission': 'automatic',
'trim': 'Startline',
'year': 2015}
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67741%27 HTTP/1.1" 200 None
2026-03-29 10:32:50 [auto1.de] INFO: Saving data for GV67741: {'auction_closing_time': 1774883589.0, 'created_time': 1773428926.223739, 'last_price_update_time': 1774780370.32202}
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV67741') HTTP/1.1" 204 0
2026-03-29 10:32:50 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-29 10:32:50 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-29 10:32:50 [auto1.de] INFO: Scrape type for PF70516: 2
2026-03-29 10:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72d61982-0975-50cb-82d8-7e25615e03d4 with identifier: PF70516
2026-03-29 10:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d61982-0975-50cb-82d8-7e25615e03d4 with scrape type 2
2026-03-29 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72d61982-0975-50cb-82d8-7e25615e03d4 with scrape type 2
2026-03-29 10:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72d61982-0975-50cb-82d8-7e25615e03d4, identifier: PF70516
2026-03-29 10:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72d61982-0975-50cb-82d8-7e25615e03d4 with identifier: PF70516
2026-03-29 10:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72d61982-0975-50cb-82d8-7e25615e03d4 with identifier: PF70516
2026-03-29 10:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72d61982-0975-50cb-82d8-7e25615e03d4 with identifier: PF70516 to the API
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:11:26Z',
'fuel_type': 'petrol',
'id': '72d61982-0975-50cb-82d8-7e25615e03d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF70516',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 114056,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-31',
'seller_name': None,
'title': 'Opel Astra 1.6 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2001}
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-29 10:32:50 [auto1.de] INFO: Saving data for PF70516: {'auction_closing_time': 1774883486.0, 'created_time': 1773741192.945392, 'last_price_update_time': 1774780370.760781}
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF70516') HTTP/1.1" 204 0
2026-03-29 10:32:50 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-29 10:32:50 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY88868%27 HTTP/1.1" 200 None
2026-03-29 10:32:50 [auto1.de] INFO: Scrape type for YY88868: 2
2026-03-29 10:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09046a87-0ba8-5534-beea-2f93029da939 with identifier: YY88868
2026-03-29 10:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09046a87-0ba8-5534-beea-2f93029da939 with scrape type 2
2026-03-29 10:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09046a87-0ba8-5534-beea-2f93029da939 with scrape type 2
2026-03-29 10:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09046a87-0ba8-5534-beea-2f93029da939, identifier: YY88868
2026-03-29 10:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09046a87-0ba8-5534-beea-2f93029da939 with identifier: YY88868
2026-03-29 10:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09046a87-0ba8-5534-beea-2f93029da939 with identifier: YY88868
2026-03-29 10:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09046a87-0ba8-5534-beea-2f93029da939 with identifier: YY88868 to the API
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:53:47Z',
'fuel_type': 'petrol',
'id': '09046a87-0ba8-5534-beea-2f93029da939',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY88868',
'listing': 'auction',
'make': 'Fiat',
'model': 'Stilo',
'odometer': 193729,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-27',
'seller_name': None,
'title': 'Fiat Stilo 1.6 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2006}
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY88868%27 HTTP/1.1" 200 None
2026-03-29 10:32:51 [auto1.de] INFO: Saving data for YY88868: {'auction_closing_time': 1774886027.0, 'created_time': 1773662198.428188, 'last_price_update_time': 1774780371.310044}
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY88868') HTTP/1.1" 204 0
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26057%27 HTTP/1.1" 200 None
2026-03-29 10:32:51 [auto1.de] INFO: Scrape type for EU26057: 2
2026-03-29 10:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69f87d73-1d35-565f-81ce-67c8f54b02e2 with identifier: EU26057
2026-03-29 10:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69f87d73-1d35-565f-81ce-67c8f54b02e2 with scrape type 2
2026-03-29 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69f87d73-1d35-565f-81ce-67c8f54b02e2 with scrape type 2
2026-03-29 10:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69f87d73-1d35-565f-81ce-67c8f54b02e2, identifier: EU26057
2026-03-29 10:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH44309/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69f87d73-1d35-565f-81ce-67c8f54b02e2 with identifier: EU26057
2026-03-29 10:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69f87d73-1d35-565f-81ce-67c8f54b02e2 with identifier: EU26057
2026-03-29 10:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69f87d73-1d35-565f-81ce-67c8f54b02e2 with identifier: EU26057 to the API
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:39:04Z',
'fuel_type': 'petrol',
'id': '69f87d73-1d35-565f-81ce-67c8f54b02e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU26057',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 312549,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-28',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Special',
'transmission': 'manual',
'trim': 'Special',
'year': 2011}
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26057%27 HTTP/1.1" 200 None
2026-03-29 10:32:51 [auto1.de] INFO: Saving data for EU26057: {'auction_closing_time': 1774885144.0, 'created_time': 1774550559.368631, 'last_price_update_time': 1774780371.763102}
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU26057') HTTP/1.1" 204 0
2026-03-29 10:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-29 10:32:51 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ45087%27 HTTP/1.1" 200 None
2026-03-29 10:32:51 [auto1.de] INFO: Scrape type for RZ45087: 2
2026-03-29 10:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec239c2-cd84-5e0c-ab05-be98b999594f with identifier: RZ45087
2026-03-29 10:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec239c2-cd84-5e0c-ab05-be98b999594f with scrape type 2
2026-03-29 10:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bec239c2-cd84-5e0c-ab05-be98b999594f with scrape type 2
2026-03-29 10:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bec239c2-cd84-5e0c-ab05-be98b999594f, identifier: RZ45087
2026-03-29 10:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bec239c2-cd84-5e0c-ab05-be98b999594f with identifier: RZ45087
2026-03-29 10:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bec239c2-cd84-5e0c-ab05-be98b999594f with identifier: RZ45087
2026-03-29 10:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bec239c2-cd84-5e0c-ab05-be98b999594f with identifier: RZ45087 to the API
2026-03-29 10:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:18:03Z',
'fuel_type': 'petrol',
'id': 'bec239c2-cd84-5e0c-ab05-be98b999594f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ45087',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 117433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-22',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Energy Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2017}
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ45087%27 HTTP/1.1" 200 None
2026-03-29 10:32:52 [auto1.de] INFO: Saving data for RZ45087: {'auction_closing_time': 1774883883.0, 'created_time': 1774377605.583812, 'last_price_update_time': 1774780372.241524}
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ45087') HTTP/1.1" 204 0
2026-03-29 10:32:52 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW35113%27 HTTP/1.1" 200 None
2026-03-29 10:32:52 [auto1.de] INFO: Scrape type for HW35113: 1
2026-03-29 10:32:52 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP80753%27 HTTP/1.1" 200 None
2026-03-29 10:32:52 [auto1.de] INFO: Scrape type for TP80753: 1
2026-03-29 10:32:52 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB48893%27 HTTP/1.1" 200 None
2026-03-29 10:32:52 [auto1.de] INFO: Scrape type for WB48893: 2
2026-03-29 10:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with identifier: WB48893
2026-03-29 10:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with scrape type 2
2026-03-29 10:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with scrape type 2
2026-03-29 10:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0, identifier: WB48893
2026-03-29 10:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with identifier: WB48893
2026-03-29 10:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with identifier: WB48893
2026-03-29 10:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0 with identifier: WB48893 to the API
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:04:00Z',
'fuel_type': 'diesel',
'id': 'ff8ff5a9-151d-5dc6-98dd-c09243bfcdc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB48893',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 94850,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-02',
'seller_name': None,
'title': 'Renault Kadjar 1.6 dCi Energy Crossborder',
'transmission': 'manual',
'trim': 'Crossborder',
'year': 2017}
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB48893%27 HTTP/1.1" 200 None
2026-03-29 10:32:52 [auto1.de] INFO: Saving data for WB48893: {'auction_closing_time': 1774883040.0, 'created_time': 1773858697.974287, 'last_price_update_time': 1774780372.852915}
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB48893') HTTP/1.1" 204 0
2026-03-29 10:32:52 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-29 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV56430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF75867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:33:06 [scrapy.extensions.logstats] INFO: Crawled 46 pages (at 14 pages/min), scraped 139 items (at 48 items/min)
2026-03-29 10:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-29 10:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW35113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:33:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP80753/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH44309> (referer: https://www.auto1.com/v1/car-details-view/AH44309/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:33:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9deb495-daca-5c9b-a1c5-c49f02bd8835 with identifier: AH44309
2026-03-29 10:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9deb495-daca-5c9b-a1c5-c49f02bd8835 with scrape type 1
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9deb495-daca-5c9b-a1c5-c49f02bd8835
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_39d01fe8a34aee4a02a8aebb65251bed.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_39d01fe8a34aee4a02a8aebb65251bed.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_843eb0caf9742dd87e3fe9221ca3e99c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_843eb0caf9742dd87e3fe9221ca3e99c.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_53203ddfa312ec6906d8f5fb759c2f81.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_53203ddfa312ec6906d8f5fb759c2f81.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_f30a38601126e98e86a8e75089720eed.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_f30a38601126e98e86a8e75089720eed.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_5fe27352821e2a957ce21ed22fef1d24.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_5fe27352821e2a957ce21ed22fef1d24.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_f82c7ac0e69f096956c7717433b7c1cf.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_f82c7ac0e69f096956c7717433b7c1cf.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_950aa6bd48a3ae9d46a7a5898ccb3e0d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_950aa6bd48a3ae9d46a7a5898ccb3e0d.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_bd92661733ec608b202c1614d0766c4f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_bd92661733ec608b202c1614d0766c4f.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_4479b9259665b149cdcf3acf417c6140.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_4479b9259665b149cdcf3acf417c6140.jpg already downloaded
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F51%252F4d5147cd4121bfcdcc7a8adad49edda0%252Fpa%252FAH44309_686f3cbbdaee345654c4bddcb1d0457f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_686f3cbbdaee345654c4bddcb1d0457f.jpg already downloaded
2026-03-29 10:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9deb495-daca-5c9b-a1c5-c49f02bd8835, identifier: AH44309
2026-03-29 10:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9deb495-daca-5c9b-a1c5-c49f02bd8835 with identifier: AH44309
2026-03-29 10:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9deb495-daca-5c9b-a1c5-c49f02bd8835 with identifier: AH44309
2026-03-29 10:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9deb495-daca-5c9b-a1c5-c49f02bd8835 with identifier: AH44309 to the API
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AH44309>
{'auction_title': '',
'c_o_2_emission_value': 26,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:35:27Z',
'fuel_type': 'hybrid',
'id': 'f9deb495-daca-5c9b-a1c5-c49f02bd8835',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH44309',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Peugeot',
'model': '508',
'odometer': 12775,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_39d01fe8a34aee4a02a8aebb65251bed.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_843eb0caf9742dd87e3fe9221ca3e99c.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_53203ddfa312ec6906d8f5fb759c2f81.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_f30a38601126e98e86a8e75089720eed.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_5fe27352821e2a957ce21ed22fef1d24.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_f82c7ac0e69f096956c7717433b7c1cf.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_950aa6bd48a3ae9d46a7a5898ccb3e0d.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_bd92661733ec608b202c1614d0766c4f.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_4479b9259665b149cdcf3acf417c6140.jpg',
'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_686f3cbbdaee345654c4bddcb1d0457f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_39d01fe8a34aee4a02a8aebb65251bed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_843eb0caf9742dd87e3fe9221ca3e99c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_53203ddfa312ec6906d8f5fb759c2f81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_f30a38601126e98e86a8e75089720eed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_5fe27352821e2a957ce21ed22fef1d24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_f82c7ac0e69f096956c7717433b7c1cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_950aa6bd48a3ae9d46a7a5898ccb3e0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_bd92661733ec608b202c1614d0766c4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_4479b9259665b149cdcf3acf417c6140.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9deb495-daca-5c9b-a1c5-c49f02bd8835/f9deb495-daca-5c9b-a1c5-c49f02bd8835_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/51/4d5147cd4121bfcdcc7a8adad49edda0/pa/AH44309_686f3cbbdaee345654c4bddcb1d0457f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-04',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 1.6 Hybrid 225 Allure',
'transmission': 'automatic',
'trim': '225 Allure',
'year': 2023}
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH44309%27 HTTP/1.1" 200 None
2026-03-29 10:33:39 [auto1.de] INFO: Saving data for AH44309: {'created_time': 1774780419.859856, 'last_price_update_time': 1774780419.859868, 'auction_closing_time': 1774884927.0}
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH44309') HTTP/1.1" 204 0
2026-03-29 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV56430> (referer: https://www.auto1.com/v1/car-details-view/YV56430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:33:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with identifier: YV56430
2026-03-29 10:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with scrape type 1
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_a7f32ecc8a3be4717db23eb8f2810c34.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_a7f32ecc8a3be4717db23eb8f2810c34.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_305726fa29122632aacd61d763b7863d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_305726fa29122632aacd61d763b7863d.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_2caa36a26b87b91bf3ecf6e9a8153907.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_2caa36a26b87b91bf3ecf6e9a8153907.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_114376239b87f96a2ae692c51d52da42.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_114376239b87f96a2ae692c51d52da42.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_b25edff5ce6884060aee6c1e44a9c532.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_b25edff5ce6884060aee6c1e44a9c532.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_649d618ee9487248385af5c1883a6a05.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_649d618ee9487248385af5c1883a6a05.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_e55c6116521e94f75a8c42703f090445.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_e55c6116521e94f75a8c42703f090445.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_5bf15e7cd44600e3ae1b9f355921cff9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_5bf15e7cd44600e3ae1b9f355921cff9.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_c174ef8565e5496ce8dc53393c0403e2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_c174ef8565e5496ce8dc53393c0403e2.jpg already downloaded
2026-03-29 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F43%252F7b43b76db689814a7a06ac9ddc2b6068%252Fpa%252FYV56430_31255ca44c341017b122f990e4359944.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_31255ca44c341017b122f990e4359944.jpg already downloaded
2026-03-29 10:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6, identifier: YV56430
2026-03-29 10:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with identifier: YV56430
2026-03-29 10:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with identifier: YV56430
2026-03-29 10:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ad49959-ca0c-5ed7-8206-f178d4ab9ba6 with identifier: YV56430 to the API
2026-03-29 10:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV56430>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:05Z',
'fuel_type': 'diesel',
'id': '8ad49959-ca0c-5ed7-8206-f178d4ab9ba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV56430',
'listing': 'auction',
'location': 'DE, Ellerau',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 95521,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_a7f32ecc8a3be4717db23eb8f2810c34.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_305726fa29122632aacd61d763b7863d.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_2caa36a26b87b91bf3ecf6e9a8153907.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_114376239b87f96a2ae692c51d52da42.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_b25edff5ce6884060aee6c1e44a9c532.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_649d618ee9487248385af5c1883a6a05.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_e55c6116521e94f75a8c42703f090445.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_5bf15e7cd44600e3ae1b9f355921cff9.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_c174ef8565e5496ce8dc53393c0403e2.jpg',
'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_31255ca44c341017b122f990e4359944.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_a7f32ecc8a3be4717db23eb8f2810c34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_305726fa29122632aacd61d763b7863d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_2caa36a26b87b91bf3ecf6e9a8153907.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_114376239b87f96a2ae692c51d52da42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_b25edff5ce6884060aee6c1e44a9c532.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_649d618ee9487248385af5c1883a6a05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_e55c6116521e94f75a8c42703f090445.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_5bf15e7cd44600e3ae1b9f355921cff9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_c174ef8565e5496ce8dc53393c0403e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad49959-ca0c-5ed7-8206-f178d4ab9ba6/8ad49959-ca0c-5ed7-8206-f178d4ab9ba6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/43/7b43b76db689814a7a06ac9ddc2b6068/pa/YV56430_31255ca44c341017b122f990e4359944.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-21',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI IQ.DRIVE',
'transmission': 'manual',
'trim': 'IQ.DRIVE',
'year': 2019}
2026-03-29 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV56430%27 HTTP/1.1" 200 None
2026-03-29 10:33:41 [auto1.de] INFO: Saving data for YV56430: {'created_time': 1774780421.622981, 'last_price_update_time': 1774780421.623, 'auction_closing_time': 1774885925.0}
2026-03-29 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV56430') HTTP/1.1" 204 0
2026-03-29 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF75867> (referer: https://www.auto1.com/v1/car-details-view/KF75867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f900c00a-792e-5af9-8a03-be98aea612d9 with identifier: KF75867
2026-03-29 10:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f900c00a-792e-5af9-8a03-be98aea612d9 with scrape type 1
2026-03-29 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f900c00a-792e-5af9-8a03-be98aea612d9
2026-03-29 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_6b366a920c64b162084c024e03d1ebd6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_6b366a920c64b162084c024e03d1ebd6.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_a087e26cdb22db876c4f703b6d73c7a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_a087e26cdb22db876c4f703b6d73c7a0.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_4230f15ff93b60a6d9f48bef4bdd43ee.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_4230f15ff93b60a6d9f48bef4bdd43ee.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_d4dea6bddf5ab39f208ac2394d1e3a66.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_d4dea6bddf5ab39f208ac2394d1e3a66.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_cb2362cafc29cabd2b980dede9f52664.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_cb2362cafc29cabd2b980dede9f52664.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_19e78cb742e76c3209240aa12b3d6b93.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_19e78cb742e76c3209240aa12b3d6b93.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_608454c6abe00884f556e13422823ab6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_608454c6abe00884f556e13422823ab6.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_e573b2415fb65b58be4ff3af049bfcdc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_e573b2415fb65b58be4ff3af049bfcdc.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_1a9aaecdcc63bc685bab1d428c11598f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_1a9aaecdcc63bc685bab1d428c11598f.jpg already downloaded
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Ff6%252Fccf66d03e3f77d7de571f37c42a507ca%252Fpa%252FKF75867_3070fc968cbf79f55d087f39533983e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_3070fc968cbf79f55d087f39533983e3.jpg already downloaded
2026-03-29 10:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f900c00a-792e-5af9-8a03-be98aea612d9, identifier: KF75867
2026-03-29 10:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f900c00a-792e-5af9-8a03-be98aea612d9 with identifier: KF75867
2026-03-29 10:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f900c00a-792e-5af9-8a03-be98aea612d9 with identifier: KF75867
2026-03-29 10:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f900c00a-792e-5af9-8a03-be98aea612d9 with identifier: KF75867 to the API
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KF75867>
{'auction_title': '',
'c_o_2_emission_value': 22,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:18:48Z',
'fuel_type': 'hybrid',
'id': 'f900c00a-792e-5af9-8a03-be98aea612d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF75867',
'listing': 'auction',
'location': 'DE, Kerpen',
'make': 'Ford',
'model': 'Kuga',
'odometer': 26778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_6b366a920c64b162084c024e03d1ebd6.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_a087e26cdb22db876c4f703b6d73c7a0.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_4230f15ff93b60a6d9f48bef4bdd43ee.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_d4dea6bddf5ab39f208ac2394d1e3a66.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_cb2362cafc29cabd2b980dede9f52664.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_19e78cb742e76c3209240aa12b3d6b93.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_608454c6abe00884f556e13422823ab6.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_e573b2415fb65b58be4ff3af049bfcdc.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_1a9aaecdcc63bc685bab1d428c11598f.jpg',
'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_3070fc968cbf79f55d087f39533983e3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_6b366a920c64b162084c024e03d1ebd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_a087e26cdb22db876c4f703b6d73c7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_4230f15ff93b60a6d9f48bef4bdd43ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_d4dea6bddf5ab39f208ac2394d1e3a66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_cb2362cafc29cabd2b980dede9f52664.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_19e78cb742e76c3209240aa12b3d6b93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_608454c6abe00884f556e13422823ab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_e573b2415fb65b58be4ff3af049bfcdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_1a9aaecdcc63bc685bab1d428c11598f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900c00a-792e-5af9-8a03-be98aea612d9/f900c00a-792e-5af9-8a03-be98aea612d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/f6/ccf66d03e3f77d7de571f37c42a507ca/pa/KF75867_3070fc968cbf79f55d087f39533983e3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2022}
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF75867%27 HTTP/1.1" 200 None
2026-03-29 10:33:43 [auto1.de] INFO: Saving data for KF75867: {'created_time': 1774780423.845276, 'last_price_update_time': 1774780423.845288, 'auction_closing_time': 1774883928.0}
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF75867') HTTP/1.1" 204 0
2026-03-29 10:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW35113> (referer: https://www.auto1.com/v1/car-details-view/HW35113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with identifier: HW35113
2026-03-29 10:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with scrape type 1
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d415c5c8-eb7c-51e7-b308-966a9a7f06e3
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_e812a2055b80d043738b725496bac2ef.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_e812a2055b80d043738b725496bac2ef.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_df9d710d547273daaaf08a5180d1f607.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_df9d710d547273daaaf08a5180d1f607.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_a77d5610d7548c3c538e64452e54948c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_a77d5610d7548c3c538e64452e54948c.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_b6f112d7fee83da8360ea721dad53b21.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_b6f112d7fee83da8360ea721dad53b21.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_5e380ebde7c34b676abd040b4df4a568.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_5e380ebde7c34b676abd040b4df4a568.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_ce918746df3bd8539033bdae3c3683ea.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_ce918746df3bd8539033bdae3c3683ea.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_2f5d7adf101dfbdf45ad017a177b0a44.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_2f5d7adf101dfbdf45ad017a177b0a44.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_74ab532372b3cf4ea4aad1ca1b2474f1.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_74ab532372b3cf4ea4aad1ca1b2474f1.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_795cdf8bc8e5af2f418ec415faa0fadc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_795cdf8bc8e5af2f418ec415faa0fadc.jpg already downloaded
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F96%252F2d96fa1e18a0e8bea1ad36365d37e5d5%252Fpa%252FHW35113_27e30cc1057f85b63683a28e4ddd4af2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_27e30cc1057f85b63683a28e4ddd4af2.jpg already downloaded
2026-03-29 10:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d415c5c8-eb7c-51e7-b308-966a9a7f06e3, identifier: HW35113
2026-03-29 10:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with identifier: HW35113
2026-03-29 10:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with identifier: HW35113
2026-03-29 10:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d415c5c8-eb7c-51e7-b308-966a9a7f06e3 with identifier: HW35113 to the API
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HW35113>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:45:30Z',
'fuel_type': 'diesel',
'id': 'd415c5c8-eb7c-51e7-b308-966a9a7f06e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW35113',
'listing': 'auction',
'location': 'DE, Lahr',
'make': 'BMW',
'model': '3er',
'odometer': 109503,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_e812a2055b80d043738b725496bac2ef.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_df9d710d547273daaaf08a5180d1f607.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_a77d5610d7548c3c538e64452e54948c.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_b6f112d7fee83da8360ea721dad53b21.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_5e380ebde7c34b676abd040b4df4a568.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_ce918746df3bd8539033bdae3c3683ea.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_2f5d7adf101dfbdf45ad017a177b0a44.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_74ab532372b3cf4ea4aad1ca1b2474f1.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_795cdf8bc8e5af2f418ec415faa0fadc.jpg',
'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_27e30cc1057f85b63683a28e4ddd4af2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_e812a2055b80d043738b725496bac2ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_df9d710d547273daaaf08a5180d1f607.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_a77d5610d7548c3c538e64452e54948c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_b6f112d7fee83da8360ea721dad53b21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_5e380ebde7c34b676abd040b4df4a568.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_ce918746df3bd8539033bdae3c3683ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_2f5d7adf101dfbdf45ad017a177b0a44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_74ab532372b3cf4ea4aad1ca1b2474f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_795cdf8bc8e5af2f418ec415faa0fadc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d415c5c8-eb7c-51e7-b308-966a9a7f06e3/d415c5c8-eb7c-51e7-b308-966a9a7f06e3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/96/2d96fa1e18a0e8bea1ad36365d37e5d5/pa/HW35113_27e30cc1057f85b63683a28e4ddd4af2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2017}
2026-03-29 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW35113%27 HTTP/1.1" 200 None
2026-03-29 10:33:46 [auto1.de] INFO: Saving data for HW35113: {'created_time': 1774780426.064653, 'last_price_update_time': 1774780426.064666, 'auction_closing_time': 1774885530.0}
2026-03-29 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW35113') HTTP/1.1" 204 0
2026-03-29 10:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP80753> (referer: https://www.auto1.com/v1/car-details-view/TP80753/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 268465e1-c221-567d-8f9f-60e789f24a24 with identifier: TP80753
2026-03-29 10:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 268465e1-c221-567d-8f9f-60e789f24a24 with scrape type 1
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 268465e1-c221-567d-8f9f-60e789f24a24
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_f96768449b7b35f582da1e200967eabc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_f96768449b7b35f582da1e200967eabc.jpg already downloaded
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_4c6ff703945f3aa03654f5a7b80b04f9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_4c6ff703945f3aa03654f5a7b80b04f9.jpg already downloaded
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_88a35eaea5ceface6ee91591fedcf496.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_88a35eaea5ceface6ee91591fedcf496.jpg already downloaded
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_9a79a468620c5446853a7366a2f6e9ec.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_9a79a468620c5446853a7366a2f6e9ec.jpg not downloaded yet
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_a1e34696a24b757cf52d3ffb389e2e3a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_a1e34696a24b757cf52d3ffb389e2e3a.jpg not downloaded yet
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_996b097448f725e8053a7adca0edeb63.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_996b097448f725e8053a7adca0edeb63.jpg already downloaded
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_d8bcb4dfb6e6a07077c8e9ba3d13233c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_d8bcb4dfb6e6a07077c8e9ba3d13233c.jpg already downloaded
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_3fe71d7e74e47e9aa113abde474949cd.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_3fe71d7e74e47e9aa113abde474949cd.jpg not downloaded yet
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_5b46336b8d79e1de2c270404aa786519.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_5b46336b8d79e1de2c270404aa786519.jpg already downloaded
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_926ea5d0d9adf6207c5fb79110b7af16.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_926ea5d0d9adf6207c5fb79110b7af16.jpg already downloaded
2026-03-29 10:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_a1e34696a24b757cf52d3ffb389e2e3a.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_9a79a468620c5446853a7366a2f6e9ec.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_3fe71d7e74e47e9aa113abde474949cd.jpg> (referer: https://www.auto1.com/)
2026-03-29 10:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856e374d0>
2026-03-29 10:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_4.jpg HTTP/1.1" 201 0
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_a1e34696a24b757cf52d3ffb389e2e3a.jpg') HTTP/1.1" 204 0
2026-03-29 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_a1e34696a24b757cf52d3ffb389e2e3a.jpg saved to cache
2026-03-29 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 268465e1-c221-567d-8f9f-60e789f24a24
2026-03-29 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856fe3dd0>
2026-03-29 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_3.jpg HTTP/1.1" 201 0
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_9a79a468620c5446853a7366a2f6e9ec.jpg') HTTP/1.1" 204 0
2026-03-29 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_9a79a468620c5446853a7366a2f6e9ec.jpg saved to cache
2026-03-29 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 268465e1-c221-567d-8f9f-60e789f24a24
2026-03-29 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7856de9350>
2026-03-29 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_7.jpg HTTP/1.1" 201 0
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fa1%252Fb4a1e044d8f44f324a9b4b8691ce64dc%252Fpa%252FTP80753_3fe71d7e74e47e9aa113abde474949cd.jpg') HTTP/1.1" 204 0
2026-03-29 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_3fe71d7e74e47e9aa113abde474949cd.jpg saved to cache
2026-03-29 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 268465e1-c221-567d-8f9f-60e789f24a24
2026-03-29 10:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 268465e1-c221-567d-8f9f-60e789f24a24, skipping ID generation
2026-03-29 10:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 268465e1-c221-567d-8f9f-60e789f24a24 with scrape type 1
2026-03-29 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 268465e1-c221-567d-8f9f-60e789f24a24 sending to next pipeline
2026-03-29 10:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 268465e1-c221-567d-8f9f-60e789f24a24, identifier: TP80753
2026-03-29 10:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 268465e1-c221-567d-8f9f-60e789f24a24 with identifier: TP80753
2026-03-29 10:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 268465e1-c221-567d-8f9f-60e789f24a24 with identifier: TP80753
2026-03-29 10:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 268465e1-c221-567d-8f9f-60e789f24a24 with identifier: TP80753 to the API
2026-03-29 10:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_3fe71d7e74e47e9aa113abde474949cd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:14:19Z',
'fuel_type': 'diesel',
'id': '268465e1-c221-567d-8f9f-60e789f24a24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP80753',
'listing': 'auction',
'location': 'DE, Atting',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 96932,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_f96768449b7b35f582da1e200967eabc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_4c6ff703945f3aa03654f5a7b80b04f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_88a35eaea5ceface6ee91591fedcf496.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_9a79a468620c5446853a7366a2f6e9ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_a1e34696a24b757cf52d3ffb389e2e3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_996b097448f725e8053a7adca0edeb63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_d8bcb4dfb6e6a07077c8e9ba3d13233c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_3fe71d7e74e47e9aa113abde474949cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_5b46336b8d79e1de2c270404aa786519.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_268465e1-c221-567d-8f9f-60e789f24a24/268465e1-c221-567d-8f9f-60e789f24a24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/a1/b4a1e044d8f44f324a9b4b8691ce64dc/pa/TP80753_926ea5d0d9adf6207c5fb79110b7af16.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2020}
2026-03-29 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP80753%27 HTTP/1.1" 200 None
2026-03-29 10:33:49 [auto1.de] INFO: Saving data for TP80753: {'created_time': 1774780429.131801, 'last_price_update_time': 1774780429.131813, 'auction_closing_time': 1774883659.0}
2026-03-29 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP80753') HTTP/1.1" 204 0
2026-03-29 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG12226> (referer: https://www.auto1.com/v1/car-details-view/JG12226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70aa5f86-7d76-51e1-89e6-a51cceef389c with identifier: JG12226
2026-03-29 10:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70aa5f86-7d76-51e1-89e6-a51cceef389c with scrape type 1
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70aa5f86-7d76-51e1-89e6-a51cceef389c
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_09a5b26ef863807066d9fb1ea3054074.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_09a5b26ef863807066d9fb1ea3054074.jpg already downloaded
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_901e9c71b55b03c9ada9489469bf7218.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_901e9c71b55b03c9ada9489469bf7218.jpg already downloaded
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_b8b9965235442baf82074e003c8723b1.png%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_b8b9965235442baf82074e003c8723b1.png already downloaded
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_65bf12f0b58c3c9d10d522bc3f6f4ad9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_65bf12f0b58c3c9d10d522bc3f6f4ad9.jpg already downloaded
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_d7d8c12e8c8880a3caf6694484d945cd.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_d7d8c12e8c8880a3caf6694484d945cd.jpg already downloaded
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_dd942abad3f92ab5ec49dd4979293f04.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_dd942abad3f92ab5ec49dd4979293f04.jpg already downloaded
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_37dba977abe99bcc563acd3c2f5d5484.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_37dba977abe99bcc563acd3c2f5d5484.jpg already downloaded
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_5da3c976da9ba0f9734c3d38edc6a466.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_5da3c976da9ba0f9734c3d38edc6a466.jpg already downloaded
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_815f09a54abb7eb1227c317215ff74ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_815f09a54abb7eb1227c317215ff74ca.jpg already downloaded
2026-03-29 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F45%252Fca45d74f671684ccf87a09f1d4695eed%252Fpa%252FJG12226_009bfce4f8820aa6b31091f11298b776.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_009bfce4f8820aa6b31091f11298b776.jpg already downloaded
2026-03-29 10:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70aa5f86-7d76-51e1-89e6-a51cceef389c, identifier: JG12226
2026-03-29 10:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70aa5f86-7d76-51e1-89e6-a51cceef389c with identifier: JG12226
2026-03-29 10:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70aa5f86-7d76-51e1-89e6-a51cceef389c with identifier: JG12226
2026-03-29 10:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70aa5f86-7d76-51e1-89e6-a51cceef389c with identifier: JG12226 to the API
2026-03-29 10:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG12226>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:12:56Z',
'fuel_type': 'diesel',
'id': '70aa5f86-7d76-51e1-89e6-a51cceef389c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG12226',
'listing': 'auction',
'location': 'DE, Erbach',
'make': 'Jaguar',
'model': 'XF',
'odometer': 84639,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_09a5b26ef863807066d9fb1ea3054074.jpg',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_901e9c71b55b03c9ada9489469bf7218.jpg',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_b8b9965235442baf82074e003c8723b1.png',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_65bf12f0b58c3c9d10d522bc3f6f4ad9.jpg',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_d7d8c12e8c8880a3caf6694484d945cd.jpg',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_dd942abad3f92ab5ec49dd4979293f04.jpg',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_37dba977abe99bcc563acd3c2f5d5484.jpg',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_5da3c976da9ba0f9734c3d38edc6a466.jpg',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_815f09a54abb7eb1227c317215ff74ca.jpg',
'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_009bfce4f8820aa6b31091f11298b776.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_09a5b26ef863807066d9fb1ea3054074.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_901e9c71b55b03c9ada9489469bf7218.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 1048085,
'Height': 568,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_b8b9965235442baf82074e003c8723b1.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_65bf12f0b58c3c9d10d522bc3f6f4ad9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_d7d8c12e8c8880a3caf6694484d945cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_dd942abad3f92ab5ec49dd4979293f04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_37dba977abe99bcc563acd3c2f5d5484.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_5da3c976da9ba0f9734c3d38edc6a466.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_815f09a54abb7eb1227c317215ff74ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70aa5f86-7d76-51e1-89e6-a51cceef389c/70aa5f86-7d76-51e1-89e6-a51cceef389c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102158,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/45/ca45d74f671684ccf87a09f1d4695eed/pa/JG12226_009bfce4f8820aa6b31091f11298b776.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar XF 25d R-Sport AWD',
'transmission': 'automatic',
'trim': 'R-Sport AWD',
'year': 2018}
2026-03-29 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG12226%27 HTTP/1.1" 200 None
2026-03-29 10:33:52 [auto1.de] INFO: Saving data for JG12226: {'created_time': 1774780432.299544, 'last_price_update_time': 1774780432.299554, 'auction_closing_time': 1774883576.0}
2026-03-29 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG12226') HTTP/1.1" 204 0
2026-03-29 10:34:06 [scrapy.extensions.logstats] INFO: Crawled 54 pages (at 8 pages/min), scraped 145 items (at 6 items/min)
2026-03-29 10:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-29 10:34:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.927(s), this was the 1st time calling it.
2026-03-29 10:34:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.4545805886764813 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 10:34:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.441(s), this was the 1st time calling it.
2026-03-29 10:34:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.815637510287191 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 10:34:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.442(s), this was the 1st time calling it.
2026-03-29 10:34:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.256584777509963 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 10:34:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 10:34:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.614(s), this was the 1st time calling it.
2026-03-29 10:34:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7539436588488915 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ28184/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 10:35:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ28184> (referer: https://www.auto1.com/v1/car-details-view/KJ28184/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.169(s), this was the 1st time calling it.
2026-03-29 10:35:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.222938175594883 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 10:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 421a0b7f-d9f3-57e4-acb1-d20744316f7c with identifier: KJ28184
2026-03-29 10:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 421a0b7f-d9f3-57e4-acb1-d20744316f7c with scrape type 1
2026-03-29 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 421a0b7f-d9f3-57e4-acb1-d20744316f7c
2026-03-29 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_24dd35e9345d9348b7722effaca20ad3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_24dd35e9345d9348b7722effaca20ad3.jpg already downloaded
2026-03-29 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_3c98f0900fe3d7bd5ee3ea940c2410dc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_3c98f0900fe3d7bd5ee3ea940c2410dc.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_a5303867b9b2dfc94ed3a1db9877adf6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_a5303867b9b2dfc94ed3a1db9877adf6.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_2aebfefad9ea182e8a3b0d6c67477492.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_2aebfefad9ea182e8a3b0d6c67477492.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_bfe5e6b5041c8839a335614a121326a6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_bfe5e6b5041c8839a335614a121326a6.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_6d8863a3c09e7a78355fac06c6d6724e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_6d8863a3c09e7a78355fac06c6d6724e.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_5023b0cc98d17b57d4763def27133f18.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_5023b0cc98d17b57d4763def27133f18.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_02296bd44b3cbc67979aedb774164731.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_02296bd44b3cbc67979aedb774164731.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_1b1daca0dcb1bc32983588480d322082.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_1b1daca0dcb1bc32983588480d322082.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F6c%252F0b6cab8b1e308b2796745293ad81863e%252Fpa%252FKJ28184_a3e643e4bc53eab548807d12a3533bf4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_a3e643e4bc53eab548807d12a3533bf4.jpg already downloaded
2026-03-29 10:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 421a0b7f-d9f3-57e4-acb1-d20744316f7c, identifier: KJ28184
2026-03-29 10:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 421a0b7f-d9f3-57e4-acb1-d20744316f7c with identifier: KJ28184
2026-03-29 10:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 421a0b7f-d9f3-57e4-acb1-d20744316f7c with identifier: KJ28184
2026-03-29 10:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 421a0b7f-d9f3-57e4-acb1-d20744316f7c with identifier: KJ28184 to the API
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KJ28184>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:45:39Z',
'fuel_type': 'petrol',
'id': '421a0b7f-d9f3-57e4-acb1-d20744316f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ28184',
'listing': 'auction',
'location': 'DE, Düsseldorf',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 125147,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_24dd35e9345d9348b7722effaca20ad3.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_3c98f0900fe3d7bd5ee3ea940c2410dc.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_a5303867b9b2dfc94ed3a1db9877adf6.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_2aebfefad9ea182e8a3b0d6c67477492.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_bfe5e6b5041c8839a335614a121326a6.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_6d8863a3c09e7a78355fac06c6d6724e.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_5023b0cc98d17b57d4763def27133f18.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_02296bd44b3cbc67979aedb774164731.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_1b1daca0dcb1bc32983588480d322082.jpg',
'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_a3e643e4bc53eab548807d12a3533bf4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_24dd35e9345d9348b7722effaca20ad3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_3c98f0900fe3d7bd5ee3ea940c2410dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_a5303867b9b2dfc94ed3a1db9877adf6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_2aebfefad9ea182e8a3b0d6c67477492.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_bfe5e6b5041c8839a335614a121326a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_6d8863a3c09e7a78355fac06c6d6724e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_5023b0cc98d17b57d4763def27133f18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_02296bd44b3cbc67979aedb774164731.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_1b1daca0dcb1bc32983588480d322082.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421a0b7f-d9f3-57e4-acb1-d20744316f7c/421a0b7f-d9f3-57e4-acb1-d20744316f7c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/6c/0b6cab8b1e308b2796745293ad81863e/pa/KJ28184_a3e643e4bc53eab548807d12a3533bf4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
'transmission': 'automatic',
'trim': 'GTI BlueMotion',
'year': 2017}
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ28184%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [auto1.de] INFO: Saving data for KJ28184: {'created_time': 1774780501.671115, 'last_price_update_time': 1774780501.671127, 'auction_closing_time': 1774885539.0}
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ28184') HTTP/1.1" 204 0
2026-03-29 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ98247> (referer: https://www.auto1.com/v1/car-details-view/LZ98247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with identifier: LZ98247
2026-03-29 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with scrape type 1
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_0a9ca724789b0a59615a2468695afe34.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_0a9ca724789b0a59615a2468695afe34.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_b68d6d1a6145eccfc9007a1b421f77df.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_b68d6d1a6145eccfc9007a1b421f77df.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_682284e099b09072c8739ae9caf4d58c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_682284e099b09072c8739ae9caf4d58c.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_cb2b269af32e06300f3f9aedea59dab6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_cb2b269af32e06300f3f9aedea59dab6.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_e69fadf1c9f6eb75f3cfecab6a067c30.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_e69fadf1c9f6eb75f3cfecab6a067c30.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_50cea62dc903e765e3024020a3b3e1fb.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_50cea62dc903e765e3024020a3b3e1fb.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_7a400cbbd33ecdc61163b43abbaaa47f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_7a400cbbd33ecdc61163b43abbaaa47f.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_2ce52f8fe9233719be450c4c94d4795a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_2ce52f8fe9233719be450c4c94d4795a.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_1051ec1fbc74084c18faf6d8d8b28a00.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_1051ec1fbc74084c18faf6d8d8b28a00.jpg already downloaded
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F0b%252F940b2464542d9161ad1afff35d7b8b4b%252Fpa%252FLZ98247_65c59d6adf47eae8f4c52fb651d3b309.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_65c59d6adf47eae8f4c52fb651d3b309.jpg already downloaded
2026-03-29 10:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2, identifier: LZ98247
2026-03-29 10:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with identifier: LZ98247
2026-03-29 10:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with identifier: LZ98247
2026-03-29 10:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2 with identifier: LZ98247 to the API
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ98247>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:42:43Z',
'fuel_type': 'diesel',
'id': '14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ98247',
'listing': 'auction',
'location': 'DE, Lüneburg',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 304447,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_0a9ca724789b0a59615a2468695afe34.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_b68d6d1a6145eccfc9007a1b421f77df.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_682284e099b09072c8739ae9caf4d58c.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_cb2b269af32e06300f3f9aedea59dab6.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_e69fadf1c9f6eb75f3cfecab6a067c30.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_50cea62dc903e765e3024020a3b3e1fb.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_7a400cbbd33ecdc61163b43abbaaa47f.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_2ce52f8fe9233719be450c4c94d4795a.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_1051ec1fbc74084c18faf6d8d8b28a00.jpg',
'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_65c59d6adf47eae8f4c52fb651d3b309.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_0a9ca724789b0a59615a2468695afe34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_b68d6d1a6145eccfc9007a1b421f77df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_682284e099b09072c8739ae9caf4d58c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_cb2b269af32e06300f3f9aedea59dab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_e69fadf1c9f6eb75f3cfecab6a067c30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_50cea62dc903e765e3024020a3b3e1fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_7a400cbbd33ecdc61163b43abbaaa47f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_2ce52f8fe9233719be450c4c94d4795a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_1051ec1fbc74084c18faf6d8d8b28a00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2/14d3e15b-e0a2-5ffe-9485-4b8cf5c9d7c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/0b/940b2464542d9161ad1afff35d7b8b4b/pa/LZ98247_65c59d6adf47eae8f4c52fb651d3b309.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-04-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2013}
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ98247%27 HTTP/1.1" 200 None
2026-03-29 10:35:02 [auto1.de] INFO: Saving data for LZ98247: {'created_time': 1774780502.461203, 'last_price_update_time': 1774780502.461214, 'auction_closing_time': 1774885363.0}
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ98247') HTTP/1.1" 204 0
2026-03-29 10:35:02 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:02 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-29 10:35:02 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-29 10:35:02 [auto1.de] INFO: Scrape type for HC78210: 2
2026-03-29 10:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e58451d-cbd2-5917-adc0-6a23154e18f2 with identifier: HC78210
2026-03-29 10:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e58451d-cbd2-5917-adc0-6a23154e18f2 with scrape type 2
2026-03-29 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e58451d-cbd2-5917-adc0-6a23154e18f2 with scrape type 2
2026-03-29 10:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e58451d-cbd2-5917-adc0-6a23154e18f2, identifier: HC78210
2026-03-29 10:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e58451d-cbd2-5917-adc0-6a23154e18f2 with identifier: HC78210
2026-03-29 10:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e58451d-cbd2-5917-adc0-6a23154e18f2 with identifier: HC78210
2026-03-29 10:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e58451d-cbd2-5917-adc0-6a23154e18f2 with identifier: HC78210 to the API
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:59:39Z',
'fuel_type': 'diesel',
'id': '0e58451d-cbd2-5917-adc0-6a23154e18f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC78210',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 340648,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-05-11',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2005}
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-29 10:35:02 [auto1.de] INFO: Saving data for HC78210: {'auction_closing_time': 1774886379.0, 'created_time': 1773858675.951025, 'last_price_update_time': 1774780502.990858}
2026-03-29 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC78210') HTTP/1.1" 204 0
2026-03-29 10:35:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:03 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK03536%27 HTTP/1.1" 200 None
2026-03-29 10:35:03 [auto1.de] INFO: Scrape type for YK03536: 2
2026-03-29 10:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with identifier: YK03536
2026-03-29 10:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with scrape type 2
2026-03-29 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with scrape type 2
2026-03-29 10:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c, identifier: YK03536
2026-03-29 10:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with identifier: YK03536
2026-03-29 10:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with identifier: YK03536
2026-03-29 10:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c with identifier: YK03536 to the API
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:50:12Z',
'fuel_type': 'diesel',
'id': '8b95dc9c-4ce4-5fd4-9999-4eb8973bc99c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK03536',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 139086,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-08',
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK03536%27 HTTP/1.1" 200 None
2026-03-29 10:35:03 [auto1.de] INFO: Saving data for YK03536: {'auction_closing_time': 1774885812.0, 'created_time': 1774550741.20991, 'last_price_update_time': 1774780503.500719}
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK03536') HTTP/1.1" 204 0
2026-03-29 10:35:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.803(s), this was the 1st time calling it.
2026-03-29 10:35:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.029448831388707 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 10:35:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 10:35:03 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-29 10:35:03 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-29 10:35:03 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-29 10:35:03 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-29 10:35:03 [auto1.de] INFO: Scrape type for VG12821: 2
2026-03-29 10:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with identifier: VG12821
2026-03-29 10:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with scrape type 2
2026-03-29 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with scrape type 2
2026-03-29 10:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9, identifier: VG12821
2026-03-29 10:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with identifier: VG12821
2026-03-29 10:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with identifier: VG12821
2026-03-29 10:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e91d896-b4ca-51ce-8544-a58f4ee2c2e9 with identifier: VG12821 to the API
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:43:55Z',
'fuel_type': 'petrol',
'id': '7e91d896-b4ca-51ce-8544-a58f4ee2c2e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG12821',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 162978,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-27',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2009}
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-29 10:35:03 [auto1.de] INFO: Saving data for VG12821: {'auction_closing_time': 1774885435.0, 'created_time': 1773946262.707518, 'last_price_update_time': 1774780503.973275}
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG12821') HTTP/1.1" 204 0
2026-03-29 10:35:04 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-29 10:35:04 [auto1.de] INFO: Scrape type for NW56335: 2
2026-03-29 10:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b7aedec-807a-52c4-b0b3-17ad070f905d with identifier: NW56335
2026-03-29 10:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7aedec-807a-52c4-b0b3-17ad070f905d with scrape type 2
2026-03-29 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b7aedec-807a-52c4-b0b3-17ad070f905d with scrape type 2
2026-03-29 10:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b7aedec-807a-52c4-b0b3-17ad070f905d, identifier: NW56335
2026-03-29 10:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b7aedec-807a-52c4-b0b3-17ad070f905d with identifier: NW56335
2026-03-29 10:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b7aedec-807a-52c4-b0b3-17ad070f905d with identifier: NW56335
2026-03-29 10:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b7aedec-807a-52c4-b0b3-17ad070f905d with identifier: NW56335 to the API
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:50:02Z',
'fuel_type': 'petrol',
'id': '0b7aedec-807a-52c4-b0b3-17ad070f905d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW56335',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 268188,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-10-14',
'seller_name': None,
'title': 'Audi A3 1.6 Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2003}
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-29 10:35:04 [auto1.de] INFO: Saving data for NW56335: {'auction_closing_time': 1774885802.0, 'created_time': 1774636912.956246, 'last_price_update_time': 1774780504.565263}
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW56335') HTTP/1.1" 204 0
2026-03-29 10:35:04 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ19003%27 HTTP/1.1" 200 None
2026-03-29 10:35:04 [auto1.de] INFO: Scrape type for EJ19003: 2
2026-03-29 10:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8447068-8851-5943-8d43-4895b043108a with identifier: EJ19003
2026-03-29 10:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8447068-8851-5943-8d43-4895b043108a with scrape type 2
2026-03-29 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8447068-8851-5943-8d43-4895b043108a with scrape type 2
2026-03-29 10:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8447068-8851-5943-8d43-4895b043108a, identifier: EJ19003
2026-03-29 10:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8447068-8851-5943-8d43-4895b043108a with identifier: EJ19003
2026-03-29 10:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8447068-8851-5943-8d43-4895b043108a with identifier: EJ19003
2026-03-29 10:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8447068-8851-5943-8d43-4895b043108a with identifier: EJ19003 to the API
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:01:27Z',
'fuel_type': 'diesel',
'id': 'd8447068-8851-5943-8d43-4895b043108a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ19003',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 112617,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-01',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ19003%27 HTTP/1.1" 200 None
2026-03-29 10:35:05 [auto1.de] INFO: Saving data for EJ19003: {'auction_closing_time': 1774882887.0, 'created_time': 1774550623.447128, 'last_price_update_time': 1774780505.065749}
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ19003') HTTP/1.1" 204 0
2026-03-29 10:35:05 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-29 10:35:05 [auto1.de] INFO: Scrape type for EL19889: 2
2026-03-29 10:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with identifier: EL19889
2026-03-29 10:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with scrape type 2
2026-03-29 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with scrape type 2
2026-03-29 10:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8, identifier: EL19889
2026-03-29 10:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with identifier: EL19889
2026-03-29 10:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with identifier: EL19889
2026-03-29 10:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8 with identifier: EL19889 to the API
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:29:35Z',
'fuel_type': 'petrol',
'id': 'b42bd7b3-afd2-5c3c-8ba6-1e0a5f2a1eb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL19889',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 116424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-26',
'seller_name': None,
'title': 'Ford B-Max 1.6 Ti-VCT Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2015}
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-29 10:35:05 [auto1.de] INFO: Saving data for EL19889: {'auction_closing_time': 1774884575.0, 'created_time': 1774463548.75596, 'last_price_update_time': 1774780505.532851}
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL19889') HTTP/1.1" 204 0
2026-03-29 10:35:05 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-29 10:35:05 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-29 10:35:05 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-29 10:35:05 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-29 10:35:05 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL04777%27 HTTP/1.1" 200 None
2026-03-29 10:35:05 [auto1.de] INFO: Scrape type for XL04777: 2
2026-03-29 10:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with identifier: XL04777
2026-03-29 10:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with scrape type 2
2026-03-29 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with scrape type 2
2026-03-29 10:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6, identifier: XL04777
2026-03-29 10:35:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 10:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with identifier: XL04777
2026-03-29 10:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with identifier: XL04777
2026-03-29 10:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e8ae712-bf0d-5c03-b93b-3f587d1df8e6 with identifier: XL04777 to the API
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:58:49Z',
'fuel_type': 'petrol',
'id': '3e8ae712-bf0d-5c03-b93b-3f587d1df8e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL04777',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 55998,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-04',
'seller_name': None,
'title': 'Opel Meriva 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2006}
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL04777%27 HTTP/1.1" 200 None
2026-03-29 10:35:06 [auto1.de] INFO: Saving data for XL04777: {'auction_closing_time': 1774886329.0, 'created_time': 1773776365.334516, 'last_price_update_time': 1774780506.105404}
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL04777') HTTP/1.1" 204 0
2026-03-29 10:35:06 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-29 10:35:06 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-29 10:35:06 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-29 10:35:06 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-29 10:35:06 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-29 10:35:06 [auto1.de] INFO: Scrape type for LE60252: 2
2026-03-29 10:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbd6ae08-11a8-52f8-813d-191547934172 with identifier: LE60252
2026-03-29 10:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbd6ae08-11a8-52f8-813d-191547934172 with scrape type 2
2026-03-29 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbd6ae08-11a8-52f8-813d-191547934172 with scrape type 2
2026-03-29 10:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbd6ae08-11a8-52f8-813d-191547934172, identifier: LE60252
2026-03-29 10:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbd6ae08-11a8-52f8-813d-191547934172 with identifier: LE60252
2026-03-29 10:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbd6ae08-11a8-52f8-813d-191547934172 with identifier: LE60252
2026-03-29 10:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbd6ae08-11a8-52f8-813d-191547934172 with identifier: LE60252 to the API
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:24Z',
'fuel_type': 'diesel',
'id': 'cbd6ae08-11a8-52f8-813d-191547934172',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE60252',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Espace',
'odometer': 213493,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-20',
'seller_name': None,
'title': 'Renault Grand Espace 2.0 dCi Espace Navitech',
'transmission': 'manual',
'trim': 'Espace Navitech',
'year': 2008}
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-29 10:35:06 [auto1.de] INFO: Saving data for LE60252: {'auction_closing_time': 1774883964.0, 'created_time': 1774636914.479164, 'last_price_update_time': 1774780506.589005}
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE60252') HTTP/1.1" 204 0
2026-03-29 10:35:06 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-29 10:35:06 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL18853%27 HTTP/1.1" 200 None
2026-03-29 10:35:06 [auto1.de] INFO: Scrape type for BL18853: 2
2026-03-29 10:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a30fa9-7643-5096-b0c6-435ac471eb04 with identifier: BL18853
2026-03-29 10:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a30fa9-7643-5096-b0c6-435ac471eb04 with scrape type 2
2026-03-29 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a30fa9-7643-5096-b0c6-435ac471eb04 with scrape type 2
2026-03-29 10:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1a30fa9-7643-5096-b0c6-435ac471eb04, identifier: BL18853
2026-03-29 10:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1a30fa9-7643-5096-b0c6-435ac471eb04 with identifier: BL18853
2026-03-29 10:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1a30fa9-7643-5096-b0c6-435ac471eb04 with identifier: BL18853
2026-03-29 10:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1a30fa9-7643-5096-b0c6-435ac471eb04 with identifier: BL18853 to the API
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:50:50Z',
'fuel_type': 'petrol',
'id': 'd1a30fa9-7643-5096-b0c6-435ac471eb04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL18853',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 86717,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-10',
'seller_name': None,
'title': 'Ford Mondeo 1.5 EcoBoost Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2019}
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL18853%27 HTTP/1.1" 200 None
2026-03-29 10:35:07 [auto1.de] INFO: Saving data for BL18853: {'auction_closing_time': 1774885850.0, 'created_time': 1774550472.168717, 'last_price_update_time': 1774780507.157088}
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL18853') HTTP/1.1" 204 0
2026-03-29 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE49281%27 HTTP/1.1" 200 None
2026-03-29 10:35:07 [auto1.de] INFO: Scrape type for XE49281: 1
2026-03-29 10:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ47065> (referer: https://www.auto1.com/v1/car-details-view/CZ47065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:07 [scrapy.extensions.logstats] INFO: Crawled 60 pages (at 6 pages/min), scraped 156 items (at 11 items/min)
2026-03-29 10:35:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY67219%27 HTTP/1.1" 200 None
2026-03-29 10:35:07 [auto1.de] INFO: Scrape type for SY67219: 2
2026-03-29 10:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce11c96-b28f-5e73-b479-cb81c82abb79 with identifier: SY67219
2026-03-29 10:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce11c96-b28f-5e73-b479-cb81c82abb79 with scrape type 2
2026-03-29 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ce11c96-b28f-5e73-b479-cb81c82abb79 with scrape type 2
2026-03-29 10:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ce11c96-b28f-5e73-b479-cb81c82abb79, identifier: SY67219
2026-03-29 10:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ce11c96-b28f-5e73-b479-cb81c82abb79 with identifier: SY67219
2026-03-29 10:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ce11c96-b28f-5e73-b479-cb81c82abb79 with identifier: SY67219
2026-03-29 10:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ce11c96-b28f-5e73-b479-cb81c82abb79 with identifier: SY67219 to the API
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:45:19Z',
'fuel_type': 'petrol',
'id': '2ce11c96-b28f-5e73-b479-cb81c82abb79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY67219',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf IV',
'odometer': 178491,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-03-28',
'seller_name': None,
'title': 'Volkswagen Golf IV 2.0 4Motion',
'transmission': 'manual',
'trim': '4Motion',
'year': 2001}
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY67219%27 HTTP/1.1" 200 None
2026-03-29 10:35:07 [auto1.de] INFO: Saving data for SY67219: {'auction_closing_time': 1774885519.0, 'created_time': 1774550566.13147, 'last_price_update_time': 1774780507.642385}
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY67219') HTTP/1.1" 204 0
2026-03-29 10:35:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-29 10:35:07 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-29 10:35:07 [auto1.de] INFO: Scrape type for NL19475: 2
2026-03-29 10:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da6da2ab-01b3-592c-85e2-401521134a28 with identifier: NL19475
2026-03-29 10:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da6da2ab-01b3-592c-85e2-401521134a28 with scrape type 2
2026-03-29 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da6da2ab-01b3-592c-85e2-401521134a28 with scrape type 2
2026-03-29 10:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da6da2ab-01b3-592c-85e2-401521134a28, identifier: NL19475
2026-03-29 10:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da6da2ab-01b3-592c-85e2-401521134a28 with identifier: NL19475
2026-03-29 10:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da6da2ab-01b3-592c-85e2-401521134a28 with identifier: NL19475
2026-03-29 10:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da6da2ab-01b3-592c-85e2-401521134a28 with identifier: NL19475 to the API
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:46:06Z',
'fuel_type': 'diesel',
'id': 'da6da2ab-01b3-592c-85e2-401521134a28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL19475',
'listing': 'auction',
'make': 'Opel',
'model': 'Signum',
'odometer': 200149,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-07-07',
'seller_name': None,
'title': 'Opel Signum 2.2 DTI Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2004}
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [auto1.de] INFO: Saving data for NL19475: {'auction_closing_time': 1774885566.0, 'created_time': 1773467545.083386, 'last_price_update_time': 1774780508.121415}
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL19475') HTTP/1.1" 204 0
2026-03-29 10:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 10:35:08 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb7f315-b94f-5574-8e44-d2070eb8cc41 with identifier: CZ47065
2026-03-29 10:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb7f315-b94f-5574-8e44-d2070eb8cc41 with scrape type 1
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abb7f315-b94f-5574-8e44-d2070eb8cc41
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_d4fdcb53c50de748261d697afa42543a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_d4fdcb53c50de748261d697afa42543a.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_a962137e6abede6bfff01eb7393c37c8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_a962137e6abede6bfff01eb7393c37c8.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_c41537b5b3c53f1c750f57fa330d3130.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_c41537b5b3c53f1c750f57fa330d3130.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_5135bcf468213abf20ada139ae82076a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_5135bcf468213abf20ada139ae82076a.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_2a9a9fda4ed2355c3ae89997107b1b3d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_2a9a9fda4ed2355c3ae89997107b1b3d.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_75173c11c2d2eb65cf6f58cd02b2e4e9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_75173c11c2d2eb65cf6f58cd02b2e4e9.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_584f0e5ff348c342691666d1faece4b8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_584f0e5ff348c342691666d1faece4b8.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_896172999aad5611127755079fee8f84.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_896172999aad5611127755079fee8f84.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_c5eecaab5a3fe265371a2da5bb4becde.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_c5eecaab5a3fe265371a2da5bb4becde.jpg already downloaded
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F3f%252Fe93ff1ae463af1aa1ba8fa1a04f3e73f%252Fpa%252FCZ47065_5f697d1063743f74859cc9767db7090f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_5f697d1063743f74859cc9767db7090f.jpg already downloaded
2026-03-29 10:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb7f315-b94f-5574-8e44-d2070eb8cc41, identifier: CZ47065
2026-03-29 10:35:08 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [auto1.de] INFO: Scrape type for WJ46196: 2
2026-03-29 10:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a844eca4-76c1-5769-a5c3-f77c52aaee81 with identifier: WJ46196
2026-03-29 10:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a844eca4-76c1-5769-a5c3-f77c52aaee81 with scrape type 2
2026-03-29 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a844eca4-76c1-5769-a5c3-f77c52aaee81 with scrape type 2
2026-03-29 10:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a844eca4-76c1-5769-a5c3-f77c52aaee81, identifier: WJ46196
2026-03-29 10:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb7f315-b94f-5574-8e44-d2070eb8cc41 with identifier: CZ47065
2026-03-29 10:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb7f315-b94f-5574-8e44-d2070eb8cc41 with identifier: CZ47065
2026-03-29 10:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb7f315-b94f-5574-8e44-d2070eb8cc41 with identifier: CZ47065 to the API
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CZ47065>
{'auction_title': '',
'c_o_2_emission_value': 203,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:55:07Z',
'fuel_type': 'diesel',
'id': 'abb7f315-b94f-5574-8e44-d2070eb8cc41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ47065',
'listing': 'auction',
'location': 'DE, Germersheim',
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 148936,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_d4fdcb53c50de748261d697afa42543a.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_a962137e6abede6bfff01eb7393c37c8.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_c41537b5b3c53f1c750f57fa330d3130.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_5135bcf468213abf20ada139ae82076a.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_2a9a9fda4ed2355c3ae89997107b1b3d.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_75173c11c2d2eb65cf6f58cd02b2e4e9.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_584f0e5ff348c342691666d1faece4b8.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_896172999aad5611127755079fee8f84.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_c5eecaab5a3fe265371a2da5bb4becde.jpg',
'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_5f697d1063743f74859cc9767db7090f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_d4fdcb53c50de748261d697afa42543a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_a962137e6abede6bfff01eb7393c37c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_c41537b5b3c53f1c750f57fa330d3130.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_5135bcf468213abf20ada139ae82076a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_2a9a9fda4ed2355c3ae89997107b1b3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_75173c11c2d2eb65cf6f58cd02b2e4e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_584f0e5ff348c342691666d1faece4b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_896172999aad5611127755079fee8f84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_c5eecaab5a3fe265371a2da5bb4becde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb7f315-b94f-5574-8e44-d2070eb8cc41/abb7f315-b94f-5574-8e44-d2070eb8cc41_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/3f/e93ff1ae463af1aa1ba8fa1a04f3e73f/pa/CZ47065_5f697d1063743f74859cc9767db7090f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-04-01',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar F-Pace 30d R-Sport AWD',
'transmission': 'automatic',
'trim': 'R-Sport AWD',
'year': 2020}
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ47065%27 HTTP/1.1" 200 None
2026-03-29 10:35:08 [auto1.de] INFO: Saving data for CZ47065: {'created_time': 1774780508.978425, 'last_price_update_time': 1774780508.978439, 'auction_closing_time': 1774886107.0}
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ47065') HTTP/1.1" 204 0
2026-03-29 10:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a844eca4-76c1-5769-a5c3-f77c52aaee81 with identifier: WJ46196
2026-03-29 10:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a844eca4-76c1-5769-a5c3-f77c52aaee81 with identifier: WJ46196
2026-03-29 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a844eca4-76c1-5769-a5c3-f77c52aaee81 with identifier: WJ46196 to the API
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:35:38Z',
'fuel_type': 'petrol',
'id': 'a844eca4-76c1-5769-a5c3-f77c52aaee81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ46196',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 182936,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-26',
'seller_name': None,
'title': 'Renault Megane 2.0 Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2006}
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-29 10:35:09 [auto1.de] INFO: Saving data for WJ46196: {'auction_closing_time': 1774884938.0, 'created_time': 1774637106.621521, 'last_price_update_time': 1774780509.308908}
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ46196') HTTP/1.1" 204 0
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR95486%27 HTTP/1.1" 200 None
2026-03-29 10:35:09 [auto1.de] INFO: Scrape type for SR95486: 2
2026-03-29 10:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcf47c34-dd44-51d8-8fac-68e45addd0ea with identifier: SR95486
2026-03-29 10:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf47c34-dd44-51d8-8fac-68e45addd0ea with scrape type 2
2026-03-29 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcf47c34-dd44-51d8-8fac-68e45addd0ea with scrape type 2
2026-03-29 10:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcf47c34-dd44-51d8-8fac-68e45addd0ea, identifier: SR95486
2026-03-29 10:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:09 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70381%27 HTTP/1.1" 200 None
2026-03-29 10:35:09 [auto1.de] INFO: Scrape type for AT70381: 2
2026-03-29 10:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with identifier: AT70381
2026-03-29 10:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with scrape type 2
2026-03-29 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with scrape type 2
2026-03-29 10:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9, identifier: AT70381
2026-03-29 10:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcf47c34-dd44-51d8-8fac-68e45addd0ea with identifier: SR95486
2026-03-29 10:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcf47c34-dd44-51d8-8fac-68e45addd0ea with identifier: SR95486
2026-03-29 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcf47c34-dd44-51d8-8fac-68e45addd0ea with identifier: SR95486 to the API
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:23:50Z',
'fuel_type': 'petrol',
'id': 'dcf47c34-dd44-51d8-8fac-68e45addd0ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR95486',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 74218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-29',
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2018}
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR95486%27 HTTP/1.1" 200 None
2026-03-29 10:35:09 [auto1.de] INFO: Saving data for SR95486: {'auction_closing_time': 1774884230.0, 'created_time': 1774550549.008847, 'last_price_update_time': 1774780509.874838}
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR95486') HTTP/1.1" 204 0
2026-03-29 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT30705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with identifier: AT70381
2026-03-29 10:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with identifier: AT70381
2026-03-29 10:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c73758b9-d2f9-51b9-8d51-e37ed1cab1b9 with identifier: AT70381 to the API
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:53:36Z',
'fuel_type': 'petrol',
'id': 'c73758b9-d2f9-51b9-8d51-e37ed1cab1b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT70381',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 162401,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2007}
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70381%27 HTTP/1.1" 200 None
2026-03-29 10:35:10 [auto1.de] INFO: Saving data for AT70381: {'auction_closing_time': 1774886016.0, 'created_time': 1774550543.362009, 'last_price_update_time': 1774780510.32044}
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT70381') HTTP/1.1" 204 0
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45010%27 HTTP/1.1" 200 None
2026-03-29 10:35:10 [auto1.de] INFO: Scrape type for WL45010: 1
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00957%27 HTTP/1.1" 200 None
2026-03-29 10:35:10 [auto1.de] INFO: Scrape type for HE00957: 1
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-29 10:35:10 [auto1.de] INFO: Scrape type for VJ55974: 2
2026-03-29 10:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b574565d-9664-5c19-a9df-4a837432dbf2 with identifier: VJ55974
2026-03-29 10:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b574565d-9664-5c19-a9df-4a837432dbf2 with scrape type 2
2026-03-29 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b574565d-9664-5c19-a9df-4a837432dbf2 with scrape type 2
2026-03-29 10:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b574565d-9664-5c19-a9df-4a837432dbf2, identifier: VJ55974
2026-03-29 10:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:10 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-29 10:35:10 [auto1.de] INFO: Scrape type for MS26334: 2
2026-03-29 10:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9733f1-ab87-542f-af6c-ea17376963f8 with identifier: MS26334
2026-03-29 10:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9733f1-ab87-542f-af6c-ea17376963f8 with scrape type 2
2026-03-29 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9733f1-ab87-542f-af6c-ea17376963f8 with scrape type 2
2026-03-29 10:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec9733f1-ab87-542f-af6c-ea17376963f8, identifier: MS26334
2026-03-29 10:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b574565d-9664-5c19-a9df-4a837432dbf2 with identifier: VJ55974
2026-03-29 10:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b574565d-9664-5c19-a9df-4a837432dbf2 with identifier: VJ55974
2026-03-29 10:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b574565d-9664-5c19-a9df-4a837432dbf2 with identifier: VJ55974 to the API
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 605,
'expiration_date': '2026-03-30T15:12:50Z',
'fuel_type': 'petrol',
'id': 'b574565d-9664-5c19-a9df-4a837432dbf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ55974',
'listing': 'auction',
'make': 'Audi',
'model': 'RS 7 Sportback',
'odometer': 138826,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-28',
'seller_name': None,
'title': 'Audi RS 7 Sportback 4.0 V8 TFSI quattro Performance',
'transmission': 'automatic',
'trim': 'quattro Performance',
'year': 2016}
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-29 10:35:10 [auto1.de] INFO: Saving data for VJ55974: {'auction_closing_time': 1774883570.0, 'created_time': 1774465645.73011, 'last_price_update_time': 1774780510.97979}
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ55974') HTTP/1.1" 204 0
2026-03-29 10:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec9733f1-ab87-542f-af6c-ea17376963f8 with identifier: MS26334
2026-03-29 10:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec9733f1-ab87-542f-af6c-ea17376963f8 with identifier: MS26334
2026-03-29 10:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec9733f1-ab87-542f-af6c-ea17376963f8 with identifier: MS26334 to the API
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:44:50Z',
'fuel_type': 'diesel',
'id': 'ec9733f1-ab87-542f-af6c-ea17376963f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS26334',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 193700,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-21',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 280 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2008}
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-29 10:35:11 [auto1.de] INFO: Saving data for MS26334: {'auction_closing_time': 1774885490.0, 'created_time': 1773400385.45689, 'last_price_update_time': 1774780511.371959}
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS26334') HTTP/1.1" 204 0
2026-03-29 10:35:11 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP11119%27 HTTP/1.1" 200 None
2026-03-29 10:35:11 [auto1.de] INFO: Scrape type for YP11119: 2
2026-03-29 10:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d09345dd-fdf8-5f8a-af35-35108c66daf5 with identifier: YP11119
2026-03-29 10:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d09345dd-fdf8-5f8a-af35-35108c66daf5 with scrape type 2
2026-03-29 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d09345dd-fdf8-5f8a-af35-35108c66daf5 with scrape type 2
2026-03-29 10:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d09345dd-fdf8-5f8a-af35-35108c66daf5, identifier: YP11119
2026-03-29 10:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:11 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ99813%27 HTTP/1.1" 200 None
2026-03-29 10:35:11 [auto1.de] INFO: Scrape type for PJ99813: 2
2026-03-29 10:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ee7351c-8143-5899-8dff-12216368bdcd with identifier: PJ99813
2026-03-29 10:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ee7351c-8143-5899-8dff-12216368bdcd with scrape type 2
2026-03-29 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ee7351c-8143-5899-8dff-12216368bdcd with scrape type 2
2026-03-29 10:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ee7351c-8143-5899-8dff-12216368bdcd, identifier: PJ99813
2026-03-29 10:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d09345dd-fdf8-5f8a-af35-35108c66daf5 with identifier: YP11119
2026-03-29 10:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d09345dd-fdf8-5f8a-af35-35108c66daf5 with identifier: YP11119
2026-03-29 10:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d09345dd-fdf8-5f8a-af35-35108c66daf5 with identifier: YP11119 to the API
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:13:54Z',
'fuel_type': 'petrol',
'id': 'd09345dd-fdf8-5f8a-af35-35108c66daf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP11119',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 22410,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-25',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2023}
2026-03-29 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP11119%27 HTTP/1.1" 200 None
2026-03-29 10:35:12 [auto1.de] INFO: Saving data for YP11119: {'auction_closing_time': 1774883634.0, 'created_time': 1773305516.83726, 'last_price_update_time': 1774780512.012544}
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP11119') HTTP/1.1" 204 0
2026-03-29 10:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ee7351c-8143-5899-8dff-12216368bdcd with identifier: PJ99813
2026-03-29 10:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ee7351c-8143-5899-8dff-12216368bdcd with identifier: PJ99813
2026-03-29 10:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ee7351c-8143-5899-8dff-12216368bdcd with identifier: PJ99813 to the API
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:16:59Z',
'fuel_type': 'petrol',
'id': '4ee7351c-8143-5899-8dff-12216368bdcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ99813',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 158847,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-23',
'seller_name': None,
'title': 'Ford S-Max 1.6 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ99813%27 HTTP/1.1" 200 None
2026-03-29 10:35:12 [auto1.de] INFO: Saving data for PJ99813: {'auction_closing_time': 1774883819.0, 'created_time': 1774291626.657574, 'last_price_update_time': 1774780512.529593}
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ99813') HTTP/1.1" 204 0
2026-03-29 10:35:12 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC32966%27 HTTP/1.1" 200 None
2026-03-29 10:35:12 [auto1.de] INFO: Scrape type for MC32966: 2
2026-03-29 10:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with identifier: MC32966
2026-03-29 10:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with scrape type 2
2026-03-29 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with scrape type 2
2026-03-29 10:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79fd9d41-4f58-5d5a-8ef9-461911454ca4, identifier: MC32966
2026-03-29 10:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:12 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-29 10:35:12 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-29 10:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with identifier: MC32966
2026-03-29 10:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with identifier: MC32966
2026-03-29 10:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79fd9d41-4f58-5d5a-8ef9-461911454ca4 with identifier: MC32966 to the API
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:50:54Z',
'fuel_type': 'petrol',
'id': '79fd9d41-4f58-5d5a-8ef9-461911454ca4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC32966',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 28365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-15',
'seller_name': None,
'title': 'BMW 2er 218i Active Tourer Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2015}
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC32966%27 HTTP/1.1" 200 None
2026-03-29 10:35:13 [auto1.de] INFO: Saving data for MC32966: {'auction_closing_time': 1774885854.0, 'created_time': 1774378030.814829, 'last_price_update_time': 1774780513.01088}
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC32966') HTTP/1.1" 204 0
2026-03-29 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE49281/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:13 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-29 10:35:13 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-29 10:35:13 [auto1.de] INFO: Scrape type for FB20654: 2
2026-03-29 10:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71d58109-f69d-5130-96b6-33955d3f04d3 with identifier: FB20654
2026-03-29 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71d58109-f69d-5130-96b6-33955d3f04d3 with scrape type 2
2026-03-29 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71d58109-f69d-5130-96b6-33955d3f04d3 with scrape type 2
2026-03-29 10:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71d58109-f69d-5130-96b6-33955d3f04d3, identifier: FB20654
2026-03-29 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR43778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71d58109-f69d-5130-96b6-33955d3f04d3 with identifier: FB20654
2026-03-29 10:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71d58109-f69d-5130-96b6-33955d3f04d3 with identifier: FB20654
2026-03-29 10:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71d58109-f69d-5130-96b6-33955d3f04d3 with identifier: FB20654 to the API
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:38:52Z',
'fuel_type': 'diesel',
'id': '71d58109-f69d-5130-96b6-33955d3f04d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB20654',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 150603,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-14',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2019}
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-29 10:35:13 [auto1.de] INFO: Saving data for FB20654: {'auction_closing_time': 1774885132.0, 'created_time': 1773859333.542529, 'last_price_update_time': 1774780513.488882}
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB20654') HTTP/1.1" 204 0
2026-03-29 10:35:13 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-29 10:35:13 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-29 10:35:13 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA50226%27 HTTP/1.1" 200 None
2026-03-29 10:35:13 [auto1.de] INFO: Scrape type for FA50226: 2
2026-03-29 10:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with identifier: FA50226
2026-03-29 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with scrape type 2
2026-03-29 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with scrape type 2
2026-03-29 10:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e, identifier: FA50226
2026-03-29 10:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with identifier: FA50226
2026-03-29 10:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with identifier: FA50226
2026-03-29 10:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9acd5550-28cc-5e65-8d13-5e112ed7ef4e with identifier: FA50226 to the API
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:12:36Z',
'fuel_type': 'diesel',
'id': '9acd5550-28cc-5e65-8d13-5e112ed7ef4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA50226',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 125239,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-19',
'seller_name': None,
'title': 'BMW X3 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA50226%27 HTTP/1.1" 200 None
2026-03-29 10:35:13 [auto1.de] INFO: Saving data for FA50226: {'auction_closing_time': 1774883556.0, 'created_time': 1773138873.010044, 'last_price_update_time': 1774780513.927739}
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA50226') HTTP/1.1" 204 0
2026-03-29 10:35:13 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-29 10:35:13 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-29 10:35:13 [auto1.de] INFO: Scrape type for SY89352: 2
2026-03-29 10:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94de415-2c77-5c58-9ea3-b444f0671c7e with identifier: SY89352
2026-03-29 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94de415-2c77-5c58-9ea3-b444f0671c7e with scrape type 2
2026-03-29 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94de415-2c77-5c58-9ea3-b444f0671c7e with scrape type 2
2026-03-29 10:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b94de415-2c77-5c58-9ea3-b444f0671c7e, identifier: SY89352
2026-03-29 10:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b94de415-2c77-5c58-9ea3-b444f0671c7e with identifier: SY89352
2026-03-29 10:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b94de415-2c77-5c58-9ea3-b444f0671c7e with identifier: SY89352
2026-03-29 10:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b94de415-2c77-5c58-9ea3-b444f0671c7e with identifier: SY89352 to the API
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 285,
'expiration_date': '2026-03-30T15:08:37Z',
'fuel_type': 'petrol',
'id': 'b94de415-2c77-5c58-9ea3-b444f0671c7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY89352',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 67151,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 3.6 V6 Sahara',
'transmission': 'automatic',
'trim': 'Sahara',
'year': 2018}
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-29 10:35:14 [auto1.de] INFO: Saving data for SY89352: {'auction_closing_time': 1774883317.0, 'created_time': 1774465065.840053, 'last_price_update_time': 1774780514.392032}
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY89352') HTTP/1.1" 204 0
2026-03-29 10:35:14 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE79096%27 HTTP/1.1" 200 None
2026-03-29 10:35:14 [auto1.de] INFO: Scrape type for YE79096: 1
2026-03-29 10:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:14 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG44569%27 HTTP/1.1" 200 None
2026-03-29 10:35:14 [auto1.de] INFO: Scrape type for XG44569: 2
2026-03-29 10:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d49ae8df-2838-57f3-9484-6d8f908fb32a with identifier: XG44569
2026-03-29 10:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49ae8df-2838-57f3-9484-6d8f908fb32a with scrape type 2
2026-03-29 10:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d49ae8df-2838-57f3-9484-6d8f908fb32a with scrape type 2
2026-03-29 10:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d49ae8df-2838-57f3-9484-6d8f908fb32a, identifier: XG44569
2026-03-29 10:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d49ae8df-2838-57f3-9484-6d8f908fb32a with identifier: XG44569
2026-03-29 10:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d49ae8df-2838-57f3-9484-6d8f908fb32a with identifier: XG44569
2026-03-29 10:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d49ae8df-2838-57f3-9484-6d8f908fb32a with identifier: XG44569 to the API
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:00:06Z',
'fuel_type': 'diesel',
'id': 'd49ae8df-2838-57f3-9484-6d8f908fb32a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG44569',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 112445,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-13',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG44569%27 HTTP/1.1" 200 None
2026-03-29 10:35:14 [auto1.de] INFO: Saving data for XG44569: {'auction_closing_time': 1774882806.0, 'created_time': 1773223531.899252, 'last_price_update_time': 1774780514.906473}
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG44569') HTTP/1.1" 204 0
2026-03-29 10:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:15 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-29 10:35:15 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE17704%27 HTTP/1.1" 200 None
2026-03-29 10:35:15 [auto1.de] INFO: Scrape type for EE17704: 2
2026-03-29 10:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with identifier: EE17704
2026-03-29 10:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with scrape type 2
2026-03-29 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with scrape type 2
2026-03-29 10:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8, identifier: EE17704
2026-03-29 10:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with identifier: EE17704
2026-03-29 10:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with identifier: EE17704
2026-03-29 10:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cd33d38-b0c9-58a9-aca6-99b0e303cbb8 with identifier: EE17704 to the API
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:40:21Z',
'fuel_type': 'diesel',
'id': '6cd33d38-b0c9-58a9-aca6-99b0e303cbb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE17704',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 210355,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-24',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE17704%27 HTTP/1.1" 200 None
2026-03-29 10:35:15 [auto1.de] INFO: Saving data for EE17704: {'auction_closing_time': 1774885221.0, 'created_time': 1772729605.258163, 'last_price_update_time': 1774780515.450721}
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE17704') HTTP/1.1" 204 0
2026-03-29 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL45010/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:15 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-29 10:35:15 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-29 10:35:15 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT63610%27 HTTP/1.1" 200 None
2026-03-29 10:35:15 [auto1.de] INFO: Scrape type for WT63610: 2
2026-03-29 10:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with identifier: WT63610
2026-03-29 10:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with scrape type 2
2026-03-29 10:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with scrape type 2
2026-03-29 10:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0, identifier: WT63610
2026-03-29 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE00957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with identifier: WT63610
2026-03-29 10:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with identifier: WT63610
2026-03-29 10:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0 with identifier: WT63610 to the API
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:08:54Z',
'fuel_type': 'diesel',
'id': 'f5d9b6a6-a7de-5a1c-8191-9e95bf3515d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT63610',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 90756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-19',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 220 d lang 4Matic Avantgarde',
'transmission': 'automatic',
'trim': 'lang 4Matic Avantgarde',
'year': 2019}
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT63610%27 HTTP/1.1" 200 None
2026-03-29 10:35:15 [auto1.de] INFO: Saving data for WT63610: {'auction_closing_time': 1774883334.0, 'created_time': 1773513081.813215, 'last_price_update_time': 1774780515.966449}
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT63610') HTTP/1.1" 204 0
2026-03-29 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT30705> (referer: https://www.auto1.com/v1/car-details-view/XT30705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:16 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-29 10:35:16 [auto1.de] INFO: Scrape type for GD86800: 2
2026-03-29 10:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with identifier: GD86800
2026-03-29 10:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with scrape type 2
2026-03-29 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with scrape type 2
2026-03-29 10:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5, identifier: GD86800
2026-03-29 10:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with identifier: GD86800
2026-03-29 10:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with identifier: GD86800
2026-03-29 10:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5 with identifier: GD86800 to the API
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:56:18Z',
'fuel_type': 'petrol',
'id': '8d6a93c4-d3ce-5204-a4e4-c8c2fb650af5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD86800',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 218118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-05',
'seller_name': None,
'title': 'Porsche Cayenne 3.0',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-29 10:35:16 [auto1.de] INFO: Saving data for GD86800: {'auction_closing_time': 1774886178.0, 'created_time': 1774465547.853721, 'last_price_update_time': 1774780516.514859}
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD86800') HTTP/1.1" 204 0
2026-03-29 10:35:16 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90206%27 HTTP/1.1" 200 None
2026-03-29 10:35:16 [auto1.de] INFO: Scrape type for MT90206: 2
2026-03-29 10:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7369f652-5f50-5b9b-8042-7b7451870f39 with identifier: MT90206
2026-03-29 10:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7369f652-5f50-5b9b-8042-7b7451870f39 with scrape type 2
2026-03-29 10:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7369f652-5f50-5b9b-8042-7b7451870f39 with scrape type 2
2026-03-29 10:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7369f652-5f50-5b9b-8042-7b7451870f39, identifier: MT90206
2026-03-29 10:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7369f652-5f50-5b9b-8042-7b7451870f39 with identifier: MT90206
2026-03-29 10:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7369f652-5f50-5b9b-8042-7b7451870f39 with identifier: MT90206
2026-03-29 10:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7369f652-5f50-5b9b-8042-7b7451870f39 with identifier: MT90206 to the API
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 144,
'expiration_date': '2026-03-30T15:01:17Z',
'fuel_type': 'diesel',
'id': '7369f652-5f50-5b9b-8042-7b7451870f39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT90206',
'listing': 'auction',
'make': 'Fiat',
'model': 'Scudo',
'odometer': 55058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-07',
'seller_name': None,
'title': 'Fiat Scudo 2.0 M-Jet L2',
'transmission': 'manual',
'trim': 'L2',
'year': 2023}
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90206%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [auto1.de] INFO: Saving data for MT90206: {'auction_closing_time': 1774882877.0, 'created_time': 1773137847.182756, 'last_price_update_time': 1774780517.056415}
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT90206') HTTP/1.1" 204 0
2026-03-29 10:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c810f55c-d60a-542b-9479-9aa50c13b5be with identifier: XT30705
2026-03-29 10:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c810f55c-d60a-542b-9479-9aa50c13b5be with scrape type 1
2026-03-29 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c810f55c-d60a-542b-9479-9aa50c13b5be
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F59%252Fbe5909cd9704a53f4b1edd9636aa54a9%252Fpa%252FXT30705_888a6cff74cdde73e868d16e0fc5ceb3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_888a6cff74cdde73e868d16e0fc5ceb3.jpg already downloaded
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F59%252Fbe5909cd9704a53f4b1edd9636aa54a9%252Fpa%252FXT30705_8a733846ac7377403abfdf5cb2ea686d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_8a733846ac7377403abfdf5cb2ea686d.jpg already downloaded
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F59%252Fbe5909cd9704a53f4b1edd9636aa54a9%252Fpa%252FXT30705_b07051d1e9e9e5b89fb5b059b7f79b1a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_b07051d1e9e9e5b89fb5b059b7f79b1a.jpg already downloaded
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F59%252Fbe5909cd9704a53f4b1edd9636aa54a9%252Fpa%252FXT30705_8466d13276dfc7d21cc6faf43e761d6f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_8466d13276dfc7d21cc6faf43e761d6f.jpg already downloaded
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F59%252Fbe5909cd9704a53f4b1edd9636aa54a9%252Fpa%252FXT30705_3c8c663261d2e008b61d7f0ecc384c95.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_3c8c663261d2e008b61d7f0ecc384c95.jpg already downloaded
2026-03-29 10:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c810f55c-d60a-542b-9479-9aa50c13b5be, identifier: XT30705
2026-03-29 10:35:17 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:17 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-29 10:35:17 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-29 10:35:17 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-29 10:35:17 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS19016%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [auto1.de] INFO: Scrape type for KS19016: 2
2026-03-29 10:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24daad38-f276-5436-b887-0fb6b6de25ed with identifier: KS19016
2026-03-29 10:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24daad38-f276-5436-b887-0fb6b6de25ed with scrape type 2
2026-03-29 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24daad38-f276-5436-b887-0fb6b6de25ed with scrape type 2
2026-03-29 10:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24daad38-f276-5436-b887-0fb6b6de25ed, identifier: KS19016
2026-03-29 10:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c810f55c-d60a-542b-9479-9aa50c13b5be with identifier: XT30705
2026-03-29 10:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c810f55c-d60a-542b-9479-9aa50c13b5be with identifier: XT30705
2026-03-29 10:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c810f55c-d60a-542b-9479-9aa50c13b5be with identifier: XT30705 to the API
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XT30705>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 3',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:43:45Z',
'fuel_type': 'petrol',
'id': 'c810f55c-d60a-542b-9479-9aa50c13b5be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT30705',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Opel',
'model': 'Astra',
'odometer': 165035,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_888a6cff74cdde73e868d16e0fc5ceb3.jpg',
'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_8a733846ac7377403abfdf5cb2ea686d.jpg',
'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_b07051d1e9e9e5b89fb5b059b7f79b1a.jpg',
'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_8466d13276dfc7d21cc6faf43e761d6f.jpg',
'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_3c8c663261d2e008b61d7f0ecc384c95.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c810f55c-d60a-542b-9479-9aa50c13b5be/c810f55c-d60a-542b-9479-9aa50c13b5be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_888a6cff74cdde73e868d16e0fc5ceb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c810f55c-d60a-542b-9479-9aa50c13b5be/c810f55c-d60a-542b-9479-9aa50c13b5be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_8a733846ac7377403abfdf5cb2ea686d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c810f55c-d60a-542b-9479-9aa50c13b5be/c810f55c-d60a-542b-9479-9aa50c13b5be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_b07051d1e9e9e5b89fb5b059b7f79b1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c810f55c-d60a-542b-9479-9aa50c13b5be/c810f55c-d60a-542b-9479-9aa50c13b5be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_8466d13276dfc7d21cc6faf43e761d6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c810f55c-d60a-542b-9479-9aa50c13b5be/c810f55c-d60a-542b-9479-9aa50c13b5be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/59/be5909cd9704a53f4b1edd9636aa54a9/pa/XT30705_3c8c663261d2e008b61d7f0ecc384c95.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2001-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.6 Basis',
'transmission': 'automatic',
'trim': 'Basis',
'year': 2001}
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT30705%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [auto1.de] INFO: Saving data for XT30705: {'created_time': 1774780517.997327, 'last_price_update_time': 1774780517.997342, 'auction_closing_time': 1774885425.0}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT30705') HTTP/1.1" 204 0
2026-03-29 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24daad38-f276-5436-b887-0fb6b6de25ed with identifier: KS19016
2026-03-29 10:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24daad38-f276-5436-b887-0fb6b6de25ed with identifier: KS19016
2026-03-29 10:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24daad38-f276-5436-b887-0fb6b6de25ed with identifier: KS19016 to the API
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:59:20Z',
'fuel_type': 'petrol',
'id': '24daad38-f276-5436-b887-0fb6b6de25ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS19016',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 162562,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-05',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Joy',
'transmission': 'manual',
'trim': 'Joy',
'year': 2016}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS19016%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Saving data for KS19016: {'auction_closing_time': 1774886360.0, 'created_time': 1773830334.113158, 'last_price_update_time': 1774780518.429792}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS19016') HTTP/1.1" 204 0
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH98568%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Scrape type for SH98568: 2
2026-03-29 10:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca7d78e5-36e3-5059-ae6c-902f911d7424 with identifier: SH98568
2026-03-29 10:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7d78e5-36e3-5059-ae6c-902f911d7424 with scrape type 2
2026-03-29 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca7d78e5-36e3-5059-ae6c-902f911d7424 with scrape type 2
2026-03-29 10:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca7d78e5-36e3-5059-ae6c-902f911d7424, identifier: SH98568
2026-03-29 10:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-29 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca7d78e5-36e3-5059-ae6c-902f911d7424 with identifier: SH98568
2026-03-29 10:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca7d78e5-36e3-5059-ae6c-902f911d7424 with identifier: SH98568
2026-03-29 10:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca7d78e5-36e3-5059-ae6c-902f911d7424 with identifier: SH98568 to the API
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 530,
'expiration_date': '2026-03-30T15:03:19Z',
'fuel_type': 'petrol',
'id': 'ca7d78e5-36e3-5059-ae6c-902f911d7424',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH98568',
'listing': 'auction',
'make': 'BMW',
'model': 'X7',
'odometer': 104021,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-13',
'seller_name': None,
'title': 'BMW X7 M50i',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH98568%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Saving data for SH98568: {'auction_closing_time': 1774882999.0, 'created_time': 1773398567.318759, 'last_price_update_time': 1774780518.876039}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH98568') HTTP/1.1" 204 0
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU56159%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Scrape type for FU56159: 0
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Scrape type for HP87515: 2
2026-03-29 10:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992ee0be-59e8-50bb-9541-d2ccd2376609 with identifier: HP87515
2026-03-29 10:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 992ee0be-59e8-50bb-9541-d2ccd2376609 with scrape type 2
2026-03-29 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 992ee0be-59e8-50bb-9541-d2ccd2376609 with scrape type 2
2026-03-29 10:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 992ee0be-59e8-50bb-9541-d2ccd2376609, identifier: HP87515
2026-03-29 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE49281> (referer: https://www.auto1.com/v1/car-details-view/XE49281/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR43778> (referer: https://www.auto1.com/v1/car-details-view/SR43778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 992ee0be-59e8-50bb-9541-d2ccd2376609 with identifier: HP87515
2026-03-29 10:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 992ee0be-59e8-50bb-9541-d2ccd2376609 with identifier: HP87515
2026-03-29 10:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 992ee0be-59e8-50bb-9541-d2ccd2376609 with identifier: HP87515 to the API
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:05:30Z',
'fuel_type': 'petrol',
'id': '992ee0be-59e8-50bb-9541-d2ccd2376609',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP87515',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 111206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-30',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
'transmission': 'manual',
'trim': 'Classic blue 2WD',
'year': 2016}
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-29 10:35:19 [auto1.de] INFO: Saving data for HP87515: {'auction_closing_time': 1774883130.0, 'created_time': 1773741513.543857, 'last_price_update_time': 1774780519.352801}
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP87515') HTTP/1.1" 204 0
2026-03-29 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE79096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:19 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-29 10:35:19 [auto1.de] INFO: Scrape type for VE03726: 2
2026-03-29 10:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-29 10:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5592bb11-65bc-56d7-90ee-c425543032ae with scrape type 2
2026-03-29 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5592bb11-65bc-56d7-90ee-c425543032ae with scrape type 2
2026-03-29 10:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5592bb11-65bc-56d7-90ee-c425543032ae, identifier: VE03726
2026-03-29 10:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-29 10:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726
2026-03-29 10:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5592bb11-65bc-56d7-90ee-c425543032ae with identifier: VE03726 to the API
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:36:42Z',
'fuel_type': 'petrol',
'id': '5592bb11-65bc-56d7-90ee-c425543032ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE03726',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 19108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-05-25',
'seller_name': None,
'title': 'Seat Ibiza 1.0 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2025}
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-29 10:35:19 [auto1.de] INFO: Saving data for VE03726: {'auction_closing_time': 1774885002.0, 'created_time': 1773133077.958781, 'last_price_update_time': 1774780519.808066}
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE03726') HTTP/1.1" 204 0
2026-03-29 10:35:19 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-29 10:35:19 [auto1.de] INFO: Scrape type for SJ83553: 2
2026-03-29 10:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with identifier: SJ83553
2026-03-29 10:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with scrape type 2
2026-03-29 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with scrape type 2
2026-03-29 10:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df, identifier: SJ83553
2026-03-29 10:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with identifier: XE49281
2026-03-29 10:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with scrape type 1
2026-03-29 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b85a9ece-9d39-5bfc-bd72-ca3431056ff3
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_bfb7eaca68c00e03b2a3e0ecf5ac9b0d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_bfb7eaca68c00e03b2a3e0ecf5ac9b0d.jpg already downloaded
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_dd446358184cd7646e1316c2df90c820.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_dd446358184cd7646e1316c2df90c820.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_a9db05b6d9377640a0e6e2dcde0ae601.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_a9db05b6d9377640a0e6e2dcde0ae601.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_1e6332f2c10bca337a841b308049a3ba.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_1e6332f2c10bca337a841b308049a3ba.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_ffc24a4b5446b7db4312ad2f32ed3e17.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ffc24a4b5446b7db4312ad2f32ed3e17.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_da86c99e4139c4e8820deac48065ab64.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_da86c99e4139c4e8820deac48065ab64.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_ee892f1b4cab5d989c742a3f2fc0db12.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ee892f1b4cab5d989c742a3f2fc0db12.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_b574400a4b503dd6789219482219b137.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_b574400a4b503dd6789219482219b137.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_3d01ff5876d150eebf77492d336ca2ae.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_3d01ff5876d150eebf77492d336ca2ae.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5d%252F055d7dbf13d3a5bbffe1a527fc596e81%252Fpa%252FXE49281_ffc9114ee1581154eb1638d355c1cddf.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ffc9114ee1581154eb1638d355c1cddf.jpg already downloaded
2026-03-29 10:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b85a9ece-9d39-5bfc-bd72-ca3431056ff3, identifier: XE49281
2026-03-29 10:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with identifier: SR43778
2026-03-29 10:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with scrape type 1
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9e2f685-9b13-525f-bcf5-dfe8727dbc16
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_bc3a2556a661f0c766ea86cab0dc9696.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_bc3a2556a661f0c766ea86cab0dc9696.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_dc686b3448949d9cd693f4b4090e25e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_dc686b3448949d9cd693f4b4090e25e3.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_ce581929881a80512728268ae2471e2a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_ce581929881a80512728268ae2471e2a.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_dfe749e32b6ee79ad48e0e84bd595444.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_dfe749e32b6ee79ad48e0e84bd595444.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_a167be6a8103ba820e8b15d74dff0e62.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_a167be6a8103ba820e8b15d74dff0e62.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_364fa17b719c44accf5ff35a9d514d05.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_364fa17b719c44accf5ff35a9d514d05.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_1512801738e332b727d88feb93b786c8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_1512801738e332b727d88feb93b786c8.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_e84bb1d0aadc6093fdf3276374657d13.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_e84bb1d0aadc6093fdf3276374657d13.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_8ed5e102cff9657de582e097ced5b53f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_8ed5e102cff9657de582e097ced5b53f.jpg already downloaded
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fc2%252F15c26825408c0715c73f310de2954a54%252Fpa%252FSR43778_4b62ca2eacdd7736e7c282f5d84fee80.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_4b62ca2eacdd7736e7c282f5d84fee80.jpg already downloaded
2026-03-29 10:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9e2f685-9b13-525f-bcf5-dfe8727dbc16, identifier: SR43778
2026-03-29 10:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with identifier: SJ83553
2026-03-29 10:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with identifier: SJ83553
2026-03-29 10:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67ab7b47-8ac7-5cb5-804b-3de22d77c3df with identifier: SJ83553 to the API
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:50:37Z',
'fuel_type': 'petrol',
'id': '67ab7b47-8ac7-5cb5-804b-3de22d77c3df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ83553',
'listing': 'auction',
'make': 'Kia',
'model': 'Stonic',
'odometer': 97718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-20',
'seller_name': None,
'title': 'Kia Stonic 1.0 TGDI Vision',
'transmission': 'manual',
'trim': 'Vision',
'year': 2019}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-29 10:35:21 [auto1.de] INFO: Saving data for SJ83553: {'auction_closing_time': 1774885837.0, 'created_time': 1773226917.29037, 'last_price_update_time': 1774780521.031822}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ83553') HTTP/1.1" 204 0
2026-03-29 10:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with identifier: XE49281
2026-03-29 10:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with identifier: XE49281
2026-03-29 10:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b85a9ece-9d39-5bfc-bd72-ca3431056ff3 with identifier: XE49281 to the API
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XE49281>
{'auction_title': '',
'c_o_2_emission_value': 327,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '2.3L',
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:44:59Z',
'fuel_type': 'diesel',
'id': 'b85a9ece-9d39-5bfc-bd72-ca3431056ff3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE49281',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Renault',
'model': 'Master',
'odometer': 44342,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_bfb7eaca68c00e03b2a3e0ecf5ac9b0d.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_dd446358184cd7646e1316c2df90c820.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_a9db05b6d9377640a0e6e2dcde0ae601.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_1e6332f2c10bca337a841b308049a3ba.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ffc24a4b5446b7db4312ad2f32ed3e17.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_da86c99e4139c4e8820deac48065ab64.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ee892f1b4cab5d989c742a3f2fc0db12.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_b574400a4b503dd6789219482219b137.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_3d01ff5876d150eebf77492d336ca2ae.jpg',
'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ffc9114ee1581154eb1638d355c1cddf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_bfb7eaca68c00e03b2a3e0ecf5ac9b0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_dd446358184cd7646e1316c2df90c820.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_a9db05b6d9377640a0e6e2dcde0ae601.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_1e6332f2c10bca337a841b308049a3ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ffc24a4b5446b7db4312ad2f32ed3e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_da86c99e4139c4e8820deac48065ab64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ee892f1b4cab5d989c742a3f2fc0db12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_b574400a4b503dd6789219482219b137.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_3d01ff5876d150eebf77492d336ca2ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b85a9ece-9d39-5bfc-bd72-ca3431056ff3/b85a9ece-9d39-5bfc-bd72-ca3431056ff3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5d/055d7dbf13d3a5bbffe1a527fc596e81/pa/XE49281_ffc9114ee1581154eb1638d355c1cddf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-26',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Master 2.3 dCi L2H1 3,5t',
'transmission': 'manual',
'trim': 'L2H1 3,5t',
'year': 2020}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE49281%27 HTTP/1.1" 200 None
2026-03-29 10:35:21 [auto1.de] INFO: Saving data for XE49281: {'created_time': 1774780521.466579, 'last_price_update_time': 1774780521.466589, 'auction_closing_time': 1774885499.0}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE49281') HTTP/1.1" 204 0
2026-03-29 10:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with identifier: SR43778
2026-03-29 10:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with identifier: SR43778
2026-03-29 10:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9e2f685-9b13-525f-bcf5-dfe8727dbc16 with identifier: SR43778 to the API
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR43778>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 141,
'expiration_date': '2026-03-30T15:04:27Z',
'fuel_type': 'hybrid',
'id': 'a9e2f685-9b13-525f-bcf5-dfe8727dbc16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR43778',
'listing': 'auction',
'location': 'DE, Lüdersfeld',
'make': 'Kia',
'model': 'Niro',
'odometer': 27606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_bc3a2556a661f0c766ea86cab0dc9696.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_dc686b3448949d9cd693f4b4090e25e3.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_ce581929881a80512728268ae2471e2a.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_dfe749e32b6ee79ad48e0e84bd595444.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_a167be6a8103ba820e8b15d74dff0e62.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_364fa17b719c44accf5ff35a9d514d05.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_1512801738e332b727d88feb93b786c8.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_e84bb1d0aadc6093fdf3276374657d13.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_8ed5e102cff9657de582e097ced5b53f.jpg',
'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_4b62ca2eacdd7736e7c282f5d84fee80.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_bc3a2556a661f0c766ea86cab0dc9696.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_dc686b3448949d9cd693f4b4090e25e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_ce581929881a80512728268ae2471e2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_dfe749e32b6ee79ad48e0e84bd595444.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_a167be6a8103ba820e8b15d74dff0e62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_364fa17b719c44accf5ff35a9d514d05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_1512801738e332b727d88feb93b786c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_e84bb1d0aadc6093fdf3276374657d13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_8ed5e102cff9657de582e097ced5b53f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e2f685-9b13-525f-bcf5-dfe8727dbc16/a9e2f685-9b13-525f-bcf5-dfe8727dbc16_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/c2/15c26825408c0715c73f310de2954a54/pa/SR43778_4b62ca2eacdd7736e7c282f5d84fee80.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Niro 1.6 Plug-in Hybrid Spirit',
'transmission': 'automatic',
'trim': 'Spirit',
'year': 2020}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR43778%27 HTTP/1.1" 200 None
2026-03-29 10:35:21 [auto1.de] INFO: Saving data for SR43778: {'created_time': 1774780521.852392, 'last_price_update_time': 1774780521.852407, 'auction_closing_time': 1774883067.0}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR43778') HTTP/1.1" 204 0
2026-03-29 10:35:21 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-29 10:35:21 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-29 10:35:21 [auto1.de] INFO: Scrape type for VC98877: 2
2026-03-29 10:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31f4eef5-8e48-5cde-bb05-a1defc6334ac with identifier: VC98877
2026-03-29 10:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31f4eef5-8e48-5cde-bb05-a1defc6334ac with scrape type 2
2026-03-29 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31f4eef5-8e48-5cde-bb05-a1defc6334ac with scrape type 2
2026-03-29 10:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31f4eef5-8e48-5cde-bb05-a1defc6334ac, identifier: VC98877
2026-03-29 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31f4eef5-8e48-5cde-bb05-a1defc6334ac with identifier: VC98877
2026-03-29 10:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31f4eef5-8e48-5cde-bb05-a1defc6334ac with identifier: VC98877
2026-03-29 10:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31f4eef5-8e48-5cde-bb05-a1defc6334ac with identifier: VC98877 to the API
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 238,
'expiration_date': '2026-03-30T15:58:29Z',
'fuel_type': 'diesel',
'id': '31f4eef5-8e48-5cde-bb05-a1defc6334ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC98877',
'listing': 'auction',
'make': 'Ford',
'model': 'Edge',
'odometer': 62171,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-28',
'seller_name': None,
'title': 'Ford Edge 2.0 TDCi EcoBlue Vignale 4x4',
'transmission': 'automatic',
'trim': 'Vignale 4x4',
'year': 2019}
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-29 10:35:22 [auto1.de] INFO: Saving data for VC98877: {'auction_closing_time': 1774886309.0, 'created_time': 1773304292.090149, 'last_price_update_time': 1774780522.428477}
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC98877') HTTP/1.1" 204 0
2026-03-29 10:35:22 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-29 10:35:22 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-29 10:35:22 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-29 10:35:22 [auto1.de] INFO: Scrape type for GL55365: 2
2026-03-29 10:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-29 10:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f813d7c8-36cf-5bc5-8929-a768a199bb5a with scrape type 2
2026-03-29 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f813d7c8-36cf-5bc5-8929-a768a199bb5a with scrape type 2
2026-03-29 10:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f813d7c8-36cf-5bc5-8929-a768a199bb5a, identifier: GL55365
2026-03-29 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL45010> (referer: https://www.auto1.com/v1/car-details-view/WL45010/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-29 10:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365
2026-03-29 10:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f813d7c8-36cf-5bc5-8929-a768a199bb5a with identifier: GL55365 to the API
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:07:16Z',
'fuel_type': 'petrol',
'id': 'f813d7c8-36cf-5bc5-8929-a768a199bb5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL55365',
'listing': 'auction',
'make': 'Lexus',
'model': 'IS-Serie',
'odometer': 160757,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-05-30',
'seller_name': None,
'title': 'Lexus IS-Serie IS 200',
'transmission': 'automatic',
'trim': '',
'year': 2001}
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Saving data for GL55365: {'auction_closing_time': 1774883236.0, 'created_time': 1773132564.471648, 'last_price_update_time': 1774780523.068294}
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL55365') HTTP/1.1" 204 0
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM39396%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Scrape type for GM39396: 2
2026-03-29 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd81f71-c04e-52c0-a8de-8168391a9d77 with identifier: GM39396
2026-03-29 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd81f71-c04e-52c0-a8de-8168391a9d77 with scrape type 2
2026-03-29 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dd81f71-c04e-52c0-a8de-8168391a9d77 with scrape type 2
2026-03-29 10:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dd81f71-c04e-52c0-a8de-8168391a9d77, identifier: GM39396
2026-03-29 10:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dd81f71-c04e-52c0-a8de-8168391a9d77 with identifier: GM39396
2026-03-29 10:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dd81f71-c04e-52c0-a8de-8168391a9d77 with identifier: GM39396
2026-03-29 10:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dd81f71-c04e-52c0-a8de-8168391a9d77 with identifier: GM39396 to the API
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:35:55Z',
'fuel_type': 'diesel',
'id': '2dd81f71-c04e-52c0-a8de-8168391a9d77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM39396',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Life',
'odometer': 111781,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-17',
'seller_name': None,
'title': 'Opel Zafira Life 2.0 CDTI L Tourer L3',
'transmission': 'automatic',
'trim': 'L Tourer L3',
'year': 2020}
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM39396%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Saving data for GM39396: {'auction_closing_time': 1774884955.0, 'created_time': 1773229481.64429, 'last_price_update_time': 1774780523.572853}
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM39396') HTTP/1.1" 204 0
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Scrape type for YU84960: 2
2026-03-29 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-29 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85bd486-6eca-5f3d-bd48-344382cca67e with scrape type 2
2026-03-29 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c85bd486-6eca-5f3d-bd48-344382cca67e with scrape type 2
2026-03-29 10:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c85bd486-6eca-5f3d-bd48-344382cca67e, identifier: YU84960
2026-03-29 10:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE00957> (referer: https://www.auto1.com/v1/car-details-view/HE00957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-29 10:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960
2026-03-29 10:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c85bd486-6eca-5f3d-bd48-344382cca67e with identifier: YU84960 to the API
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:50:06Z',
'fuel_type': 'diesel',
'id': 'c85bd486-6eca-5f3d-bd48-344382cca67e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU84960',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 121182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-26',
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi BOSE Edition',
'transmission': 'automatic',
'trim': 'BOSE Edition',
'year': 2014}
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Saving data for YU84960: {'auction_closing_time': 1774885806.0, 'created_time': 1773307909.355575, 'last_price_update_time': 1774780524.119201}
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU84960') HTTP/1.1" 204 0
2026-03-29 10:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42117a82-ed35-52dd-9e84-86d59a76b485 with identifier: WL45010
2026-03-29 10:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42117a82-ed35-52dd-9e84-86d59a76b485 with scrape type 1
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 42117a82-ed35-52dd-9e84-86d59a76b485
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_fd4ccd72170327294e36d630a5f276c8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_fd4ccd72170327294e36d630a5f276c8.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_02c492aba6219476d9da34e726fb14f5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_02c492aba6219476d9da34e726fb14f5.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_7d84cee1b4593967aa1097a42830cc52.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_7d84cee1b4593967aa1097a42830cc52.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_e2f58a82a2082bca0430748a14ecab78.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_e2f58a82a2082bca0430748a14ecab78.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_f18c7bbdaef362687bc004e8b86c7391.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_f18c7bbdaef362687bc004e8b86c7391.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_8204310487ce52c4934087099dfcd0ba.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_8204310487ce52c4934087099dfcd0ba.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_248fcff2365eb7d1f47abe897deb5b13.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_248fcff2365eb7d1f47abe897deb5b13.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_bc7cc0506b48072a65f5a859eab9bc10.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_bc7cc0506b48072a65f5a859eab9bc10.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_fae7869235f91c704d0ba9bd6ae0820b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_fae7869235f91c704d0ba9bd6ae0820b.jpg already downloaded
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F0a%252F550afb54f24810f34702bf4d32716272%252Fpa%252FWL45010_df41458737c549c4dac851e14b9b118a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_df41458737c549c4dac851e14b9b118a.jpg already downloaded
2026-03-29 10:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42117a82-ed35-52dd-9e84-86d59a76b485, identifier: WL45010
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for WJ57335: 2
2026-03-29 10:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-29 10:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with scrape type 2
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with scrape type 2
2026-03-29 10:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36, identifier: WJ57335
2026-03-29 10:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42117a82-ed35-52dd-9e84-86d59a76b485 with identifier: WL45010
2026-03-29 10:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42117a82-ed35-52dd-9e84-86d59a76b485 with identifier: WL45010
2026-03-29 10:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42117a82-ed35-52dd-9e84-86d59a76b485 with identifier: WL45010 to the API
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL45010>
{'auction_title': '',
'c_o_2_emission_value': 222,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:03:57Z',
'fuel_type': 'diesel',
'id': '42117a82-ed35-52dd-9e84-86d59a76b485',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL45010',
'listing': 'auction',
'location': 'DE, Buch',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 73528,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_fd4ccd72170327294e36d630a5f276c8.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_02c492aba6219476d9da34e726fb14f5.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_7d84cee1b4593967aa1097a42830cc52.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_e2f58a82a2082bca0430748a14ecab78.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_f18c7bbdaef362687bc004e8b86c7391.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_8204310487ce52c4934087099dfcd0ba.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_248fcff2365eb7d1f47abe897deb5b13.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_bc7cc0506b48072a65f5a859eab9bc10.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_fae7869235f91c704d0ba9bd6ae0820b.jpg',
'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_df41458737c549c4dac851e14b9b118a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_fd4ccd72170327294e36d630a5f276c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_02c492aba6219476d9da34e726fb14f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_7d84cee1b4593967aa1097a42830cc52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_e2f58a82a2082bca0430748a14ecab78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_f18c7bbdaef362687bc004e8b86c7391.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_8204310487ce52c4934087099dfcd0ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_248fcff2365eb7d1f47abe897deb5b13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_bc7cc0506b48072a65f5a859eab9bc10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_fae7869235f91c704d0ba9bd6ae0820b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42117a82-ed35-52dd-9e84-86d59a76b485/42117a82-ed35-52dd-9e84-86d59a76b485_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/0a/550afb54f24810f34702bf4d32716272/pa/WL45010_df41458737c549c4dac851e14b9b118a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-03',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Generation Six 4Motion',
'year': 2021}
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45010%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Saving data for WL45010: {'created_time': 1774780524.935651, 'last_price_update_time': 1774780524.935661, 'auction_closing_time': 1774883037.0}
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL45010') HTTP/1.1" 204 0
2026-03-29 10:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-29 10:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335
2026-03-29 10:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b933d39-d6dd-5350-8cb3-2ab68ec55a36 with identifier: WJ57335 to the API
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:01Z',
'fuel_type': 'diesel',
'id': '1b933d39-d6dd-5350-8cb3-2ab68ec55a36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ57335',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 231046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-05',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2017}
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [auto1.de] INFO: Saving data for WJ57335: {'auction_closing_time': 1774884001.0, 'created_time': 1772543141.804452, 'last_price_update_time': 1774780525.292098}
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ57335') HTTP/1.1" 204 0
2026-03-29 10:35:25 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [auto1.de] INFO: Scrape type for HK49782: 2
2026-03-29 10:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842f715b-c653-56d6-b615-cb453eac5fdd with identifier: HK49782
2026-03-29 10:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842f715b-c653-56d6-b615-cb453eac5fdd with scrape type 2
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 842f715b-c653-56d6-b615-cb453eac5fdd with scrape type 2
2026-03-29 10:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 842f715b-c653-56d6-b615-cb453eac5fdd, identifier: HK49782
2026-03-29 10:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 842f715b-c653-56d6-b615-cb453eac5fdd with identifier: HK49782
2026-03-29 10:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 842f715b-c653-56d6-b615-cb453eac5fdd with identifier: HK49782
2026-03-29 10:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 842f715b-c653-56d6-b615-cb453eac5fdd with identifier: HK49782 to the API
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:27:58Z',
'fuel_type': 'petrol',
'id': '842f715b-c653-56d6-b615-cb453eac5fdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK49782',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 74160,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-12',
'seller_name': None,
'title': 'BMW 5er 525i',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [auto1.de] INFO: Saving data for HK49782: {'auction_closing_time': 1774884478.0, 'created_time': 1773344080.428709, 'last_price_update_time': 1774780525.77232}
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK49782') HTTP/1.1" 204 0
2026-03-29 10:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with identifier: HE00957
2026-03-29 10:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with scrape type 1
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bdb2d0b-6c34-5026-9321-3fbf35e373b1
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_76a7aa342cd862049728923045d2e196.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_76a7aa342cd862049728923045d2e196.jpg already downloaded
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_f7e4901f6867ff9b74627ca4f6070e6b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_f7e4901f6867ff9b74627ca4f6070e6b.jpg already downloaded
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_81ef485c22d85f512a350c1adacbf21b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_81ef485c22d85f512a350c1adacbf21b.jpg already downloaded
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_0b6b482123b1c8354b488200664d7c63.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_0b6b482123b1c8354b488200664d7c63.jpg already downloaded
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_d3d303a13eef60310de30bee345193a9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_d3d303a13eef60310de30bee345193a9.jpg already downloaded
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_d08e06899aeb5157780d851781cd00e2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_d08e06899aeb5157780d851781cd00e2.jpg already downloaded
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_599cd064917a61396e181dedbbc7649a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_599cd064917a61396e181dedbbc7649a.jpg already downloaded
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_5611cba8f9600ffff74dafad800d317f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_5611cba8f9600ffff74dafad800d317f.jpg already downloaded
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_9d9ed472062268c814bf4caa5b105e71.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_9d9ed472062268c814bf4caa5b105e71.jpg already downloaded
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F66%252Fbf663fa7f6af47a67bfe6d13536bcc3d%252Fpa%252FHE00957_498ece2b327df5cd097773028fc19bf4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_498ece2b327df5cd097773028fc19bf4.jpg already downloaded
2026-03-29 10:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1, identifier: HE00957
2026-03-29 10:35:26 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:26 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [auto1.de] INFO: Scrape type for JT65336: 2
2026-03-29 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-29 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with scrape type 2
2026-03-29 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with scrape type 2
2026-03-29 10:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60a2ee00-9b33-5bee-9ed6-63b6175bf234, identifier: JT65336
2026-03-29 10:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with identifier: HE00957
2026-03-29 10:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with identifier: HE00957
2026-03-29 10:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bdb2d0b-6c34-5026-9321-3fbf35e373b1 with identifier: HE00957 to the API
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HE00957>
{'auction_title': '',
'c_o_2_emission_value': 257,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:32:36Z',
'fuel_type': 'petrol',
'id': '3bdb2d0b-6c34-5026-9321-3fbf35e373b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE00957',
'listing': 'auction',
'location': 'DE, Kitzingen',
'make': 'BMW',
'model': '3er',
'odometer': 54500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_76a7aa342cd862049728923045d2e196.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_f7e4901f6867ff9b74627ca4f6070e6b.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_81ef485c22d85f512a350c1adacbf21b.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_0b6b482123b1c8354b488200664d7c63.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_d3d303a13eef60310de30bee345193a9.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_d08e06899aeb5157780d851781cd00e2.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_599cd064917a61396e181dedbbc7649a.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_5611cba8f9600ffff74dafad800d317f.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_9d9ed472062268c814bf4caa5b105e71.jpg',
'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_498ece2b327df5cd097773028fc19bf4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_76a7aa342cd862049728923045d2e196.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_f7e4901f6867ff9b74627ca4f6070e6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_81ef485c22d85f512a350c1adacbf21b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_0b6b482123b1c8354b488200664d7c63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_d3d303a13eef60310de30bee345193a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_d08e06899aeb5157780d851781cd00e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_599cd064917a61396e181dedbbc7649a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_5611cba8f9600ffff74dafad800d317f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_9d9ed472062268c814bf4caa5b105e71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb2d0b-6c34-5026-9321-3fbf35e373b1/3bdb2d0b-6c34-5026-9321-3fbf35e373b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/66/bf663fa7f6af47a67bfe6d13536bcc3d/pa/HE00957_498ece2b327df5cd097773028fc19bf4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-11-17',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 3er 330i',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00957%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [auto1.de] INFO: Saving data for HE00957: {'created_time': 1774780526.649121, 'last_price_update_time': 1774780526.649135, 'auction_closing_time': 1774884756.0}
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE00957') HTTP/1.1" 204 0
2026-03-29 10:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-29 10:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336
2026-03-29 10:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60a2ee00-9b33-5bee-9ed6-63b6175bf234 with identifier: JT65336 to the API
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:02:39Z',
'fuel_type': 'diesel',
'id': '60a2ee00-9b33-5bee-9ed6-63b6175bf234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT65336',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 180706,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-21',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI United BlueMotion',
'transmission': 'manual',
'trim': 'United BlueMotion',
'year': 2009}
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-29 10:35:27 [auto1.de] INFO: Saving data for JT65336: {'auction_closing_time': 1774882959.0, 'created_time': 1773741502.894159, 'last_price_update_time': 1774780527.057865}
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT65336') HTTP/1.1" 204 0
2026-03-29 10:35:27 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-29 10:35:27 [auto1.de] INFO: Scrape type for HL50945: 2
2026-03-29 10:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c723fe53-500c-574f-ac8c-0e53210181df with identifier: HL50945
2026-03-29 10:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c723fe53-500c-574f-ac8c-0e53210181df with scrape type 2
2026-03-29 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c723fe53-500c-574f-ac8c-0e53210181df with scrape type 2
2026-03-29 10:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c723fe53-500c-574f-ac8c-0e53210181df, identifier: HL50945
2026-03-29 10:35:27 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-29 10:35:27 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR88683%27 HTTP/1.1" 200 None
2026-03-29 10:35:27 [auto1.de] INFO: Scrape type for BR88683: 2
2026-03-29 10:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1dcd530-2946-50bf-af58-3f14db6b599d with identifier: BR88683
2026-03-29 10:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1dcd530-2946-50bf-af58-3f14db6b599d with scrape type 2
2026-03-29 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1dcd530-2946-50bf-af58-3f14db6b599d with scrape type 2
2026-03-29 10:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1dcd530-2946-50bf-af58-3f14db6b599d, identifier: BR88683
2026-03-29 10:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c723fe53-500c-574f-ac8c-0e53210181df with identifier: HL50945
2026-03-29 10:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c723fe53-500c-574f-ac8c-0e53210181df with identifier: HL50945
2026-03-29 10:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c723fe53-500c-574f-ac8c-0e53210181df with identifier: HL50945 to the API
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:33:54Z',
'fuel_type': 'diesel',
'id': 'c723fe53-500c-574f-ac8c-0e53210181df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL50945',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 250565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-12',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Comfort Limited',
'transmission': 'manual',
'trim': 'Comfort Limited',
'year': 2007}
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-29 10:35:27 [auto1.de] INFO: Saving data for HL50945: {'auction_closing_time': 1774884834.0, 'created_time': 1773741559.388115, 'last_price_update_time': 1774780527.682927}
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL50945') HTTP/1.1" 204 0
2026-03-29 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1dcd530-2946-50bf-af58-3f14db6b599d with identifier: BR88683
2026-03-29 10:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1dcd530-2946-50bf-af58-3f14db6b599d with identifier: BR88683
2026-03-29 10:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1dcd530-2946-50bf-af58-3f14db6b599d with identifier: BR88683 to the API
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 349,
'expiration_date': '2026-03-30T15:10:41Z',
'fuel_type': 'diesel',
'id': 'f1dcd530-2946-50bf-af58-3f14db6b599d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR88683',
'listing': 'auction',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 125090,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-23',
'seller_name': None,
'title': 'Audi A6 Allroad 55 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR88683%27 HTTP/1.1" 200 None
2026-03-29 10:35:28 [auto1.de] INFO: Saving data for BR88683: {'auction_closing_time': 1774883441.0, 'created_time': 1773226292.049471, 'last_price_update_time': 1774780528.056414}
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR88683') HTTP/1.1" 204 0
2026-03-29 10:35:28 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-29 10:35:28 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-29 10:35:28 [auto1.de] INFO: Scrape type for JE28257: 2
2026-03-29 10:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4063b49-853d-5a20-acfa-de130931ca1c with identifier: JE28257
2026-03-29 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4063b49-853d-5a20-acfa-de130931ca1c with scrape type 2
2026-03-29 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4063b49-853d-5a20-acfa-de130931ca1c with scrape type 2
2026-03-29 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4063b49-853d-5a20-acfa-de130931ca1c, identifier: JE28257
2026-03-29 10:35:28 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-29 10:35:28 [auto1.de] INFO: Scrape type for PY66131: 2
2026-03-29 10:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-29 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cceb328-bdf5-5998-9122-703414400433 with scrape type 2
2026-03-29 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cceb328-bdf5-5998-9122-703414400433 with scrape type 2
2026-03-29 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cceb328-bdf5-5998-9122-703414400433, identifier: PY66131
2026-03-29 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4063b49-853d-5a20-acfa-de130931ca1c with identifier: JE28257
2026-03-29 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4063b49-853d-5a20-acfa-de130931ca1c with identifier: JE28257
2026-03-29 10:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4063b49-853d-5a20-acfa-de130931ca1c with identifier: JE28257 to the API
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:20:31Z',
'fuel_type': 'petrol',
'id': 'a4063b49-853d-5a20-acfa-de130931ca1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE28257',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 104145,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-31',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.0 eTSI Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2021}
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-29 10:35:28 [auto1.de] INFO: Saving data for JE28257: {'auction_closing_time': 1774884031.0, 'created_time': 1774466697.433898, 'last_price_update_time': 1774780528.655453}
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE28257') HTTP/1.1" 204 0
2026-03-29 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-29 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131
2026-03-29 10:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cceb328-bdf5-5998-9122-703414400433 with identifier: PY66131 to the API
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:01:16Z',
'fuel_type': 'petrol',
'id': '3cceb328-bdf5-5998-9122-703414400433',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY66131',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 162837,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-19',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2013}
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-29 10:35:29 [auto1.de] INFO: Saving data for PY66131: {'auction_closing_time': 1774882876.0, 'created_time': 1773303026.616629, 'last_price_update_time': 1774780529.052218}
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY66131') HTTP/1.1" 204 0
2026-03-29 10:35:29 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-29 10:35:29 [auto1.de] INFO: Scrape type for TK71200: 2
2026-03-29 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb78a93-930f-5462-9818-2f31aab4cbe5 with identifier: TK71200
2026-03-29 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb78a93-930f-5462-9818-2f31aab4cbe5 with scrape type 2
2026-03-29 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdb78a93-930f-5462-9818-2f31aab4cbe5 with scrape type 2
2026-03-29 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdb78a93-930f-5462-9818-2f31aab4cbe5, identifier: TK71200
2026-03-29 10:35:29 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-29 10:35:29 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-29 10:35:29 [auto1.de] INFO: Scrape type for AL04579: 2
2026-03-29 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with identifier: AL04579
2026-03-29 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with scrape type 2
2026-03-29 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with scrape type 2
2026-03-29 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c, identifier: AL04579
2026-03-29 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdb78a93-930f-5462-9818-2f31aab4cbe5 with identifier: TK71200
2026-03-29 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdb78a93-930f-5462-9818-2f31aab4cbe5 with identifier: TK71200
2026-03-29 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdb78a93-930f-5462-9818-2f31aab4cbe5 with identifier: TK71200 to the API
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:11:07Z',
'fuel_type': 'diesel',
'id': 'cdb78a93-930f-5462-9818-2f31aab4cbe5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK71200',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 97654,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-28',
'seller_name': None,
'title': 'Hyundai Tucson 2.0 CRDi Mild-Hybrid Premium 4WD',
'transmission': 'automatic',
'trim': 'Premium 4WD',
'year': 2020}
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-29 10:35:29 [auto1.de] INFO: Saving data for TK71200: {'auction_closing_time': 1774883467.0, 'created_time': 1773226578.090019, 'last_price_update_time': 1774780529.691137}
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK71200') HTTP/1.1" 204 0
2026-03-29 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with identifier: AL04579
2026-03-29 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with identifier: AL04579
2026-03-29 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abbbd8bb-1578-5c93-b4c3-af4a27a0a03c with identifier: AL04579 to the API
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:20:21Z',
'fuel_type': 'diesel',
'id': 'abbbd8bb-1578-5c93-b4c3-af4a27a0a03c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL04579',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 147428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-16',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2017}
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Saving data for AL04579: {'auction_closing_time': 1774884021.0, 'created_time': 1773304581.267532, 'last_price_update_time': 1774780530.093045}
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL04579') HTTP/1.1" 204 0
2026-03-29 10:35:30 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Scrape type for EZ46252: 2
2026-03-29 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db1a6439-9dd5-5cef-b656-881472626fae with identifier: EZ46252
2026-03-29 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db1a6439-9dd5-5cef-b656-881472626fae with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db1a6439-9dd5-5cef-b656-881472626fae with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db1a6439-9dd5-5cef-b656-881472626fae, identifier: EZ46252
2026-03-29 10:35:30 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH10753%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Scrape type for NH10753: 1
2026-03-29 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db1a6439-9dd5-5cef-b656-881472626fae with identifier: EZ46252
2026-03-29 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db1a6439-9dd5-5cef-b656-881472626fae with identifier: EZ46252
2026-03-29 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db1a6439-9dd5-5cef-b656-881472626fae with identifier: EZ46252 to the API
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:36:57Z',
'fuel_type': 'diesel',
'id': 'db1a6439-9dd5-5cef-b656-881472626fae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ46252',
'listing': 'auction',
'make': 'Toyota',
'model': 'ProAce Verso',
'odometer': 150456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-19',
'seller_name': None,
'title': 'Toyota ProAce Verso 2.0 D-4D L1 Executive',
'transmission': 'automatic',
'trim': 'L1 Executive',
'year': 2017}
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Saving data for EZ46252: {'auction_closing_time': 1774885017.0, 'created_time': 1773227402.069294, 'last_price_update_time': 1774780530.576313}
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ46252') HTTP/1.1" 204 0
2026-03-29 10:35:30 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-29 10:35:30 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN40523%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Scrape type for DN40523: 2
2026-03-29 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70fe76a0-a763-5b4a-9037-497d77e5508e with identifier: DN40523
2026-03-29 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70fe76a0-a763-5b4a-9037-497d77e5508e with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70fe76a0-a763-5b4a-9037-497d77e5508e with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70fe76a0-a763-5b4a-9037-497d77e5508e, identifier: DN40523
2026-03-29 10:35:30 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Scrape type for CA14151: 2
2026-03-29 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60936903-5396-5d54-a62c-b4abe434b4dd with identifier: CA14151
2026-03-29 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60936903-5396-5d54-a62c-b4abe434b4dd with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60936903-5396-5d54-a62c-b4abe434b4dd with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60936903-5396-5d54-a62c-b4abe434b4dd, identifier: CA14151
2026-03-29 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70fe76a0-a763-5b4a-9037-497d77e5508e with identifier: DN40523
2026-03-29 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70fe76a0-a763-5b4a-9037-497d77e5508e with identifier: DN40523
2026-03-29 10:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70fe76a0-a763-5b4a-9037-497d77e5508e with identifier: DN40523 to the API
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:39:30Z',
'fuel_type': 'petrol',
'id': '70fe76a0-a763-5b4a-9037-497d77e5508e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN40523',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 38827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-25',
'seller_name': None,
'title': 'Seat Arona 1.0 TSI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2019}
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN40523%27 HTTP/1.1" 200 None
2026-03-29 10:35:31 [auto1.de] INFO: Saving data for DN40523: {'auction_closing_time': 1774885170.0, 'created_time': 1773229029.88382, 'last_price_update_time': 1774780531.460598}
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN40523') HTTP/1.1" 204 0
2026-03-29 10:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60936903-5396-5d54-a62c-b4abe434b4dd with identifier: CA14151
2026-03-29 10:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60936903-5396-5d54-a62c-b4abe434b4dd with identifier: CA14151
2026-03-29 10:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60936903-5396-5d54-a62c-b4abe434b4dd with identifier: CA14151 to the API
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:24Z',
'fuel_type': 'petrol',
'id': '60936903-5396-5d54-a62c-b4abe434b4dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA14151',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 31590,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-16',
'seller_name': None,
'title': 'Seat Arona 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2021}
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-29 10:35:31 [auto1.de] INFO: Saving data for CA14151: {'auction_closing_time': 1774884984.0, 'created_time': 1773304595.022845, 'last_price_update_time': 1774780531.867356}
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA14151') HTTP/1.1" 204 0
2026-03-29 10:35:31 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ45397%27 HTTP/1.1" 200 None
2026-03-29 10:35:31 [auto1.de] INFO: Scrape type for XJ45397: 2
2026-03-29 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178fb53f-3b70-5e02-8390-b3f1b535883b with identifier: XJ45397
2026-03-29 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178fb53f-3b70-5e02-8390-b3f1b535883b with scrape type 2
2026-03-29 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 178fb53f-3b70-5e02-8390-b3f1b535883b with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 178fb53f-3b70-5e02-8390-b3f1b535883b, identifier: XJ45397
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Scrape type for EF04397: 2
2026-03-29 10:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8a2653b-9fd2-5570-8c74-56076c8f2c3e with identifier: EF04397
2026-03-29 10:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8a2653b-9fd2-5570-8c74-56076c8f2c3e with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8a2653b-9fd2-5570-8c74-56076c8f2c3e with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8a2653b-9fd2-5570-8c74-56076c8f2c3e, identifier: EF04397
2026-03-29 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 178fb53f-3b70-5e02-8390-b3f1b535883b with identifier: XJ45397
2026-03-29 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 178fb53f-3b70-5e02-8390-b3f1b535883b with identifier: XJ45397
2026-03-29 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 178fb53f-3b70-5e02-8390-b3f1b535883b with identifier: XJ45397 to the API
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:58:10Z',
'fuel_type': 'petrol',
'id': '178fb53f-3b70-5e02-8390-b3f1b535883b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ45397',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto',
'odometer': 161198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-23',
'seller_name': None,
'title': 'Fiat Punto 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2013}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ45397%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Saving data for XJ45397: {'auction_closing_time': 1774886290.0, 'created_time': 1773228044.054939, 'last_price_update_time': 1774780532.448412}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ45397') HTTP/1.1" 204 0
2026-03-29 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8a2653b-9fd2-5570-8c74-56076c8f2c3e with identifier: EF04397
2026-03-29 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8a2653b-9fd2-5570-8c74-56076c8f2c3e with identifier: EF04397
2026-03-29 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8a2653b-9fd2-5570-8c74-56076c8f2c3e with identifier: EF04397 to the API
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:56:05Z',
'fuel_type': 'diesel',
'id': 'd8a2653b-9fd2-5570-8c74-56076c8f2c3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF04397',
'listing': 'auction',
'make': 'Toyota',
'model': 'Verso',
'odometer': 172007,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-25',
'seller_name': None,
'title': 'Toyota Verso 1.6 D-4D Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2014}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Saving data for EF04397: {'auction_closing_time': 1774886165.0, 'created_time': 1773344852.300675, 'last_price_update_time': 1774780532.826204}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF04397') HTTP/1.1" 204 0
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR32079%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Scrape type for NR32079: 2
2026-03-29 10:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with identifier: NR32079
2026-03-29 10:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d8a16f-569c-52f2-be1a-2cfe68c14d46, identifier: NR32079
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP86111%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Scrape type for PP86111: 2
2026-03-29 10:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ab55785-6495-55aa-bde6-fe91eb74615e with identifier: PP86111
2026-03-29 10:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ab55785-6495-55aa-bde6-fe91eb74615e with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ab55785-6495-55aa-bde6-fe91eb74615e with scrape type 2
2026-03-29 10:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ab55785-6495-55aa-bde6-fe91eb74615e, identifier: PP86111
2026-03-29 10:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with identifier: NR32079
2026-03-29 10:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with identifier: NR32079
2026-03-29 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d8a16f-569c-52f2-be1a-2cfe68c14d46 with identifier: NR32079 to the API
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:55:40Z',
'fuel_type': 'petrol',
'id': '32d8a16f-569c-52f2-be1a-2cfe68c14d46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR32079',
'listing': 'auction',
'make': 'Infiniti',
'model': 'Q30',
'odometer': 61135,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-22',
'seller_name': None,
'title': 'Infiniti Q30 2.0 Turbo Sport AWD',
'transmission': 'automatic',
'trim': 'Sport AWD',
'year': 2017}
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR32079%27 HTTP/1.1" 200 None
2026-03-29 10:35:33 [auto1.de] INFO: Saving data for NR32079: {'auction_closing_time': 1774886140.0, 'created_time': 1774550506.409733, 'last_price_update_time': 1774780533.423713}
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR32079') HTTP/1.1" 204 0
2026-03-29 10:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ab55785-6495-55aa-bde6-fe91eb74615e with identifier: PP86111
2026-03-29 10:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ab55785-6495-55aa-bde6-fe91eb74615e with identifier: PP86111
2026-03-29 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ab55785-6495-55aa-bde6-fe91eb74615e with identifier: PP86111 to the API
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 341,
'expiration_date': '2026-03-30T15:28:23Z',
'fuel_type': 'diesel',
'id': '9ab55785-6495-55aa-bde6-fe91eb74615e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP86111',
'listing': 'auction',
'make': 'Audi',
'model': 'S5',
'odometer': 37959,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-16',
'seller_name': None,
'title': 'Audi S5 3.0 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2022}
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP86111%27 HTTP/1.1" 200 None
2026-03-29 10:35:34 [auto1.de] INFO: Saving data for PP86111: {'auction_closing_time': 1774884503.0, 'created_time': 1774378044.095621, 'last_price_update_time': 1774780534.497631}
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP86111') HTTP/1.1" 204 0
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-29 10:35:34 [auto1.de] INFO: Scrape type for GZ01520: 2
2026-03-29 10:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41ec7453-e521-5e7c-b712-f7112f9dcb91 with identifier: GZ01520
2026-03-29 10:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41ec7453-e521-5e7c-b712-f7112f9dcb91 with scrape type 2
2026-03-29 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41ec7453-e521-5e7c-b712-f7112f9dcb91 with scrape type 2
2026-03-29 10:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41ec7453-e521-5e7c-b712-f7112f9dcb91, identifier: GZ01520
2026-03-29 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-29 10:35:34 [auto1.de] INFO: Scrape type for AU99703: 2
2026-03-29 10:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-29 10:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1236c9c-5744-5503-bb3b-74015f186529 with scrape type 2
2026-03-29 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1236c9c-5744-5503-bb3b-74015f186529 with scrape type 2
2026-03-29 10:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1236c9c-5744-5503-bb3b-74015f186529, identifier: AU99703
2026-03-29 10:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41ec7453-e521-5e7c-b712-f7112f9dcb91 with identifier: GZ01520
2026-03-29 10:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41ec7453-e521-5e7c-b712-f7112f9dcb91 with identifier: GZ01520
2026-03-29 10:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41ec7453-e521-5e7c-b712-f7112f9dcb91 with identifier: GZ01520 to the API
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 435,
'expiration_date': '2026-03-30T15:50:57Z',
'fuel_type': 'diesel',
'id': '41ec7453-e521-5e7c-b712-f7112f9dcb91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ01520',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ7',
'odometer': 142760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'Audi SQ7 4.0 V8 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-29 10:35:35 [auto1.de] INFO: Saving data for GZ01520: {'auction_closing_time': 1774885857.0, 'created_time': 1774465467.656539, 'last_price_update_time': 1774780535.134023}
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ01520') HTTP/1.1" 204 0
2026-03-29 10:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-29 10:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-29 10:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703 to the API
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:06Z',
'fuel_type': 'diesel',
'id': 'b1236c9c-5744-5503-bb3b-74015f186529',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU99703',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 202455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-29',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-29 10:35:35 [auto1.de] INFO: Saving data for AU99703: {'auction_closing_time': 1774885626.0, 'created_time': 1774031831.509064, 'last_price_update_time': 1774780535.471826}
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU99703') HTTP/1.1" 204 0
2026-03-29 10:35:35 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD79431%27 HTTP/1.1" 200 None
2026-03-29 10:35:35 [auto1.de] INFO: Scrape type for PD79431: 2
2026-03-29 10:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 129768fb-0d4c-5772-8e69-f8a39615cf4d with identifier: PD79431
2026-03-29 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129768fb-0d4c-5772-8e69-f8a39615cf4d with scrape type 2
2026-03-29 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 129768fb-0d4c-5772-8e69-f8a39615cf4d with scrape type 2
2026-03-29 10:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 129768fb-0d4c-5772-8e69-f8a39615cf4d, identifier: PD79431
2026-03-29 10:35:35 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-29 10:35:35 [auto1.de] INFO: Scrape type for UJ07162: 2
2026-03-29 10:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with identifier: UJ07162
2026-03-29 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with scrape type 2
2026-03-29 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with scrape type 2
2026-03-29 10:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85, identifier: UJ07162
2026-03-29 10:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 129768fb-0d4c-5772-8e69-f8a39615cf4d with identifier: PD79431
2026-03-29 10:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 129768fb-0d4c-5772-8e69-f8a39615cf4d with identifier: PD79431
2026-03-29 10:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 129768fb-0d4c-5772-8e69-f8a39615cf4d with identifier: PD79431 to the API
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:24:36Z',
'fuel_type': 'diesel',
'id': '129768fb-0d4c-5772-8e69-f8a39615cf4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD79431',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 304967,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-01',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2013}
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD79431%27 HTTP/1.1" 200 None
2026-03-29 10:35:36 [auto1.de] INFO: Saving data for PD79431: {'auction_closing_time': 1774884276.0, 'created_time': 1773136852.979523, 'last_price_update_time': 1774780536.565112}
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD79431') HTTP/1.1" 204 0
2026-03-29 10:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with identifier: UJ07162
2026-03-29 10:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with identifier: UJ07162
2026-03-29 10:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c1ac5af-4b92-53f4-a51c-9afa8ad2af85 with identifier: UJ07162 to the API
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:58:02Z',
'fuel_type': 'petrol',
'id': '4c1ac5af-4b92-53f4-a51c-9afa8ad2af85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ07162',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 69109,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-27',
'seller_name': None,
'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
'transmission': 'automatic',
'trim': 'VZ 4Drive',
'year': 2020}
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-29 10:35:36 [auto1.de] INFO: Saving data for UJ07162: {'auction_closing_time': 1774886282.0, 'created_time': 1773342702.751157, 'last_price_update_time': 1774780536.922081}
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ07162') HTTP/1.1" 204 0
2026-03-29 10:35:36 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-29 10:35:36 [auto1.de] INFO: Scrape type for RS30445: 2
2026-03-29 10:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-29 10:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad27732-66bf-55b6-85c1-679ddc0d5dcf with scrape type 2
2026-03-29 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aad27732-66bf-55b6-85c1-679ddc0d5dcf with scrape type 2
2026-03-29 10:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aad27732-66bf-55b6-85c1-679ddc0d5dcf, identifier: RS30445
2026-03-29 10:35:37 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-29 10:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-29 10:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445
2026-03-29 10:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aad27732-66bf-55b6-85c1-679ddc0d5dcf with identifier: RS30445 to the API
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:26:36Z',
'fuel_type': 'petrol',
'id': 'aad27732-66bf-55b6-85c1-679ddc0d5dcf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS30445',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 40042,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-14',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2021}
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-29 10:35:37 [auto1.de] INFO: Saving data for RS30445: {'auction_closing_time': 1774884396.0, 'created_time': 1773307340.322549, 'last_price_update_time': 1774780537.381518}
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS30445') HTTP/1.1" 204 0
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-29 10:35:37 [auto1.de] INFO: Scrape type for VN22748: 2
2026-03-29 10:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with identifier: VN22748
2026-03-29 10:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with scrape type 2
2026-03-29 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with scrape type 2
2026-03-29 10:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c02fcef-b0e4-50d0-90f2-49f596c70c58, identifier: VN22748
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-29 10:35:37 [auto1.de] INFO: Scrape type for HS83117: 0
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-29 10:35:37 [auto1.de] INFO: Scrape type for RW76455: 2
2026-03-29 10:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-29 10:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04c92a5f-7935-5023-b523-054134cd48cd with scrape type 2
2026-03-29 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04c92a5f-7935-5023-b523-054134cd48cd with scrape type 2
2026-03-29 10:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04c92a5f-7935-5023-b523-054134cd48cd, identifier: RW76455
2026-03-29 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE79096> (referer: https://www.auto1.com/v1/car-details-view/YE79096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with identifier: VN22748
2026-03-29 10:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with identifier: VN22748
2026-03-29 10:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c02fcef-b0e4-50d0-90f2-49f596c70c58 with identifier: VN22748 to the API
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:20:17Z',
'fuel_type': 'petrol',
'id': '3c02fcef-b0e4-50d0-90f2-49f596c70c58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN22748',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 72489,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-09',
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [auto1.de] INFO: Saving data for VN22748: {'auction_closing_time': 1774884017.0, 'created_time': 1773225725.136457, 'last_price_update_time': 1774780538.121007}
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN22748') HTTP/1.1" 204 0
2026-03-29 10:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-29 10:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455
2026-03-29 10:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04c92a5f-7935-5023-b523-054134cd48cd with identifier: RW76455 to the API
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:06:17Z',
'fuel_type': 'petrol',
'id': '04c92a5f-7935-5023-b523-054134cd48cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW76455',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 131878,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-02',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
'transmission': 'automatic',
'trim': 'T 4Matic',
'year': 2017}
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [auto1.de] INFO: Saving data for RW76455: {'auction_closing_time': 1774883177.0, 'created_time': 1773136603.936512, 'last_price_update_time': 1774780538.466843}
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW76455') HTTP/1.1" 204 0
2026-03-29 10:35:38 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK28670%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [auto1.de] INFO: Scrape type for BK28670: 2
2026-03-29 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8438f47-b298-591c-894c-861e7924548f with identifier: BK28670
2026-03-29 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8438f47-b298-591c-894c-861e7924548f with scrape type 2
2026-03-29 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8438f47-b298-591c-894c-861e7924548f with scrape type 2
2026-03-29 10:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8438f47-b298-591c-894c-861e7924548f, identifier: BK28670
2026-03-29 10:35:38 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [auto1.de] INFO: Scrape type for RP66782: 2
2026-03-29 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2924ab11-323c-5f0d-adea-34e1cb94fce0 with identifier: RP66782
2026-03-29 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2924ab11-323c-5f0d-adea-34e1cb94fce0 with scrape type 2
2026-03-29 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2924ab11-323c-5f0d-adea-34e1cb94fce0 with scrape type 2
2026-03-29 10:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2924ab11-323c-5f0d-adea-34e1cb94fce0, identifier: RP66782
2026-03-29 10:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8438f47-b298-591c-894c-861e7924548f with identifier: BK28670
2026-03-29 10:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8438f47-b298-591c-894c-861e7924548f with identifier: BK28670
2026-03-29 10:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8438f47-b298-591c-894c-861e7924548f with identifier: BK28670 to the API
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 381,
'expiration_date': '2026-03-30T15:27:32Z',
'fuel_type': 'petrol',
'id': 'b8438f47-b298-591c-894c-861e7924548f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK28670',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 164952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-11',
'seller_name': None,
'title': 'Porsche Macan GTS',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK28670%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [auto1.de] INFO: Saving data for BK28670: {'auction_closing_time': 1774884452.0, 'created_time': 1774378003.300909, 'last_price_update_time': 1774780539.079257}
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK28670') HTTP/1.1" 204 0
2026-03-29 10:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2924ab11-323c-5f0d-adea-34e1cb94fce0 with identifier: RP66782
2026-03-29 10:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2924ab11-323c-5f0d-adea-34e1cb94fce0 with identifier: RP66782
2026-03-29 10:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2924ab11-323c-5f0d-adea-34e1cb94fce0 with identifier: RP66782 to the API
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:10:49Z',
'fuel_type': 'petrol',
'id': '2924ab11-323c-5f0d-adea-34e1cb94fce0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP66782',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 131591,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-07',
'seller_name': None,
'title': 'BMW X3 xDrive 20i',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [auto1.de] INFO: Saving data for RP66782: {'auction_closing_time': 1774883449.0, 'created_time': 1773343694.994787, 'last_price_update_time': 1774780539.465132}
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP66782') HTTP/1.1" 204 0
2026-03-29 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH10753/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:39 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [auto1.de] INFO: Scrape type for AK90767: 2
2026-03-29 10:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff2e5450-4a4c-5fe5-93f5-1817776adb88 with identifier: AK90767
2026-03-29 10:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2e5450-4a4c-5fe5-93f5-1817776adb88 with scrape type 2
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff2e5450-4a4c-5fe5-93f5-1817776adb88 with scrape type 2
2026-03-29 10:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff2e5450-4a4c-5fe5-93f5-1817776adb88, identifier: AK90767
2026-03-29 10:35:39 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29911%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [auto1.de] INFO: Scrape type for RC29911: 1
2026-03-29 10:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff2e5450-4a4c-5fe5-93f5-1817776adb88 with identifier: AK90767
2026-03-29 10:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff2e5450-4a4c-5fe5-93f5-1817776adb88 with identifier: AK90767
2026-03-29 10:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff2e5450-4a4c-5fe5-93f5-1817776adb88 with identifier: AK90767 to the API
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:18:41Z',
'fuel_type': 'petrol',
'id': 'ff2e5450-4a4c-5fe5-93f5-1817776adb88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK90767',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 78485,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-03',
'seller_name': None,
'title': 'Porsche Cayenne 3.0',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [auto1.de] INFO: Saving data for AK90767: {'auction_closing_time': 1774883921.0, 'created_time': 1774465470.040961, 'last_price_update_time': 1774780540.00082}
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK90767') HTTP/1.1" 204 0
2026-03-29 10:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53a1fd5-8e51-5347-932b-e5d28f2c116e with identifier: YE79096
2026-03-29 10:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53a1fd5-8e51-5347-932b-e5d28f2c116e with scrape type 1
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e53a1fd5-8e51-5347-932b-e5d28f2c116e
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_cc3a01ea0252f31a6530f9113c3d9d6c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_cc3a01ea0252f31a6530f9113c3d9d6c.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_274ca2262b0656ce6d6580e4b486591e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_274ca2262b0656ce6d6580e4b486591e.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_2cc029586545ca55196aceaa5291b7e0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_2cc029586545ca55196aceaa5291b7e0.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_2911e5823687cf393dbf0d2cd9e4e2f1.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_2911e5823687cf393dbf0d2cd9e4e2f1.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_51ad20395172d0be6f9317493384516f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_51ad20395172d0be6f9317493384516f.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_fe3a0cce553fe2844577cf32098b35d0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_fe3a0cce553fe2844577cf32098b35d0.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_a44312cf3a6706c2bbd4fe431536fb22.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_a44312cf3a6706c2bbd4fe431536fb22.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_f4b6906e353bcd4ba2d8b90f7d8b8bc7.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_f4b6906e353bcd4ba2d8b90f7d8b8bc7.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_d54f309d74c1e7f82298c82a0219c829.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_d54f309d74c1e7f82298c82a0219c829.jpg already downloaded
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f21918c9843c7aa8fca4e5277083a%252Fpa%252FYE79096_529eb18861ca629ed3633b299a1021d5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_529eb18861ca629ed3633b299a1021d5.jpg already downloaded
2026-03-29 10:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e53a1fd5-8e51-5347-932b-e5d28f2c116e, identifier: YE79096
2026-03-29 10:35:40 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB02108%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [auto1.de] INFO: Scrape type for TB02108: 2
2026-03-29 10:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with identifier: TB02108
2026-03-29 10:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with scrape type 2
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with scrape type 2
2026-03-29 10:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00483fdf-43b0-5ce3-b8ea-980f79cc7726, identifier: TB02108
2026-03-29 10:35:40 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-29 10:35:40 [auto1.de] INFO: Scrape type for VL48750: 2
2026-03-29 10:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12353123-ac97-552b-8ef8-a740ad95ff07 with identifier: VL48750
2026-03-29 10:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12353123-ac97-552b-8ef8-a740ad95ff07 with scrape type 2
2026-03-29 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12353123-ac97-552b-8ef8-a740ad95ff07 with scrape type 2
2026-03-29 10:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12353123-ac97-552b-8ef8-a740ad95ff07, identifier: VL48750
2026-03-29 10:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e53a1fd5-8e51-5347-932b-e5d28f2c116e with identifier: YE79096
2026-03-29 10:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e53a1fd5-8e51-5347-932b-e5d28f2c116e with identifier: YE79096
2026-03-29 10:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e53a1fd5-8e51-5347-932b-e5d28f2c116e with identifier: YE79096 to the API
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YE79096>
{'auction_title': '',
'c_o_2_emission_value': 161,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 179,
'expiration_date': '2026-03-30T15:32:11Z',
'fuel_type': 'petrol',
'id': 'e53a1fd5-8e51-5347-932b-e5d28f2c116e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE79096',
'listing': 'auction',
'location': 'DE, Kippenheim',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 57234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_cc3a01ea0252f31a6530f9113c3d9d6c.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_274ca2262b0656ce6d6580e4b486591e.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_2cc029586545ca55196aceaa5291b7e0.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_2911e5823687cf393dbf0d2cd9e4e2f1.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_51ad20395172d0be6f9317493384516f.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_fe3a0cce553fe2844577cf32098b35d0.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_a44312cf3a6706c2bbd4fe431536fb22.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_f4b6906e353bcd4ba2d8b90f7d8b8bc7.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_d54f309d74c1e7f82298c82a0219c829.jpg',
'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_529eb18861ca629ed3633b299a1021d5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_cc3a01ea0252f31a6530f9113c3d9d6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_274ca2262b0656ce6d6580e4b486591e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_2cc029586545ca55196aceaa5291b7e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_2911e5823687cf393dbf0d2cd9e4e2f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_51ad20395172d0be6f9317493384516f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_fe3a0cce553fe2844577cf32098b35d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89131,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_a44312cf3a6706c2bbd4fe431536fb22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_f4b6906e353bcd4ba2d8b90f7d8b8bc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_d54f309d74c1e7f82298c82a0219c829.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a1fd5-8e51-5347-932b-e5d28f2c116e/e53a1fd5-8e51-5347-932b-e5d28f2c116e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f21918c9843c7aa8fca4e5277083a/pa/YE79096_529eb18861ca629ed3633b299a1021d5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Prestige 4WD',
'transmission': 'automatic',
'trim': 'Prestige 4WD',
'year': 2021}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE79096%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Saving data for YE79096: {'created_time': 1774780541.110761, 'last_price_update_time': 1774780541.110777, 'auction_closing_time': 1774884731.0}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE79096') HTTP/1.1" 204 0
2026-03-29 10:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with identifier: TB02108
2026-03-29 10:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with identifier: TB02108
2026-03-29 10:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00483fdf-43b0-5ce3-b8ea-980f79cc7726 with identifier: TB02108 to the API
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:41:02Z',
'fuel_type': 'diesel',
'id': '00483fdf-43b0-5ce3-b8ea-980f79cc7726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB02108',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 110427,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-08',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Tourneo Titanium X',
'transmission': 'manual',
'trim': '320 L2 Tourneo Titanium X',
'year': 2019}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB02108%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Saving data for TB02108: {'auction_closing_time': 1774885262.0, 'created_time': 1774291953.351933, 'last_price_update_time': 1774780541.521231}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB02108') HTTP/1.1" 204 0
2026-03-29 10:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12353123-ac97-552b-8ef8-a740ad95ff07 with identifier: VL48750
2026-03-29 10:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12353123-ac97-552b-8ef8-a740ad95ff07 with identifier: VL48750
2026-03-29 10:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12353123-ac97-552b-8ef8-a740ad95ff07 with identifier: VL48750 to the API
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:11:49Z',
'fuel_type': 'diesel',
'id': '12353123-ac97-552b-8ef8-a740ad95ff07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL48750',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 260617,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-19',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
'transmission': 'manual',
'trim': 'Business Edition BlueMotion',
'year': 2014}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Saving data for VL48750: {'auction_closing_time': 1774883509.0, 'created_time': 1773229061.772808, 'last_price_update_time': 1774780541.923262}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL48750') HTTP/1.1" 204 0
2026-03-29 10:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:41 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27698%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Scrape type for GB27698: 2
2026-03-29 10:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a486434-9d28-530a-90cf-4bd728b83ed0 with identifier: GB27698
2026-03-29 10:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a486434-9d28-530a-90cf-4bd728b83ed0 with scrape type 2
2026-03-29 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a486434-9d28-530a-90cf-4bd728b83ed0 with scrape type 2
2026-03-29 10:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a486434-9d28-530a-90cf-4bd728b83ed0, identifier: GB27698
2026-03-29 10:35:42 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-29 10:35:42 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-29 10:35:42 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-29 10:35:42 [auto1.de] INFO: Scrape type for WC25701: 2
2026-03-29 10:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-29 10:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with scrape type 2
2026-03-29 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with scrape type 2
2026-03-29 10:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da, identifier: WC25701
2026-03-29 10:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a486434-9d28-530a-90cf-4bd728b83ed0 with identifier: GB27698
2026-03-29 10:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a486434-9d28-530a-90cf-4bd728b83ed0 with identifier: GB27698
2026-03-29 10:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a486434-9d28-530a-90cf-4bd728b83ed0 with identifier: GB27698 to the API
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:32Z',
'fuel_type': 'diesel',
'id': '4a486434-9d28-530a-90cf-4bd728b83ed0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB27698',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Kombi',
'odometer': 41142,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-03',
'seller_name': None,
'title': 'Volkswagen T6 Kombi 2.0 TDI EcoProfi lang FWD',
'transmission': 'automatic',
'trim': 'EcoProfi lang FWD',
'year': 2021}
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27698%27 HTTP/1.1" 200 None
2026-03-29 10:35:42 [auto1.de] INFO: Saving data for GB27698: {'auction_closing_time': 1774885832.0, 'created_time': 1773341977.374827, 'last_price_update_time': 1774780542.67072}
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB27698') HTTP/1.1" 204 0
2026-03-29 10:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-29 10:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701
2026-03-29 10:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51b87b72-a6a0-55bc-9521-d6aa3e99d4da with identifier: WC25701 to the API
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:43:34Z',
'fuel_type': 'diesel',
'id': '51b87b72-a6a0-55bc-9521-d6aa3e99d4da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC25701',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Transporter',
'odometer': 95598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-14',
'seller_name': None,
'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2016}
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-29 10:35:43 [auto1.de] INFO: Saving data for WC25701: {'auction_closing_time': 1774885414.0, 'created_time': 1773138513.906347, 'last_price_update_time': 1774780543.087418}
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC25701') HTTP/1.1" 204 0
2026-03-29 10:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:43 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-29 10:35:43 [auto1.de] INFO: Scrape type for YC23372: 2
2026-03-29 10:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with identifier: YC23372
2026-03-29 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with scrape type 2
2026-03-29 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with scrape type 2
2026-03-29 10:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071, identifier: YC23372
2026-03-29 10:35:43 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS41901%27 HTTP/1.1" 200 None
2026-03-29 10:35:43 [auto1.de] INFO: Scrape type for RS41901: 2
2026-03-29 10:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5df2e86e-169c-5177-8259-fd5bc1315a2b with identifier: RS41901
2026-03-29 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5df2e86e-169c-5177-8259-fd5bc1315a2b with scrape type 2
2026-03-29 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5df2e86e-169c-5177-8259-fd5bc1315a2b with scrape type 2
2026-03-29 10:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5df2e86e-169c-5177-8259-fd5bc1315a2b, identifier: RS41901
2026-03-29 10:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with identifier: YC23372
2026-03-29 10:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with identifier: YC23372
2026-03-29 10:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47e1a34a-9f1b-5c15-9fcb-d62cb843c071 with identifier: YC23372 to the API
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 408,
'expiration_date': '2026-03-30T15:40:59Z',
'fuel_type': 'petrol',
'id': '47e1a34a-9f1b-5c15-9fcb-d62cb843c071',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC23372',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 53447,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-07',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 43 AMG Mild-Hybrid 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2023}
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-29 10:35:43 [auto1.de] INFO: Saving data for YC23372: {'auction_closing_time': 1774885259.0, 'created_time': 1774464859.971545, 'last_price_update_time': 1774780543.669226}
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC23372') HTTP/1.1" 204 0
2026-03-29 10:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5df2e86e-169c-5177-8259-fd5bc1315a2b with identifier: RS41901
2026-03-29 10:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5df2e86e-169c-5177-8259-fd5bc1315a2b with identifier: RS41901
2026-03-29 10:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5df2e86e-169c-5177-8259-fd5bc1315a2b with identifier: RS41901 to the API
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 350,
'expiration_date': '2026-03-30T15:45:11Z',
'fuel_type': 'petrol',
'id': '5df2e86e-169c-5177-8259-fd5bc1315a2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS41901',
'listing': 'auction',
'make': 'Porsche',
'model': '718 Boxster',
'odometer': 46352,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-17',
'seller_name': None,
'title': 'Porsche 718 Boxster S',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS41901%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Saving data for RS41901: {'auction_closing_time': 1774885511.0, 'created_time': 1774378009.470574, 'last_price_update_time': 1774780544.011808}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS41901') HTTP/1.1" 204 0
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11944%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Scrape type for WA11944: 2
2026-03-29 10:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with identifier: WA11944
2026-03-29 10:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70e47495-d3e1-5b0e-abcf-a45d1adecd79, identifier: WA11944
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Scrape type for CW57830: 2
2026-03-29 10:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-29 10:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35f96e5-5799-5631-b461-1088215b4928 with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35f96e5-5799-5631-b461-1088215b4928 with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b35f96e5-5799-5631-b461-1088215b4928, identifier: CW57830
2026-03-29 10:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with identifier: WA11944
2026-03-29 10:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with identifier: WA11944
2026-03-29 10:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70e47495-d3e1-5b0e-abcf-a45d1adecd79 with identifier: WA11944 to the API
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:47:30Z',
'fuel_type': 'diesel',
'id': '70e47495-d3e1-5b0e-abcf-a45d1adecd79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA11944',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 130045,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-20',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2017}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11944%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Saving data for WA11944: {'auction_closing_time': 1774885650.0, 'created_time': 1773227275.478985, 'last_price_update_time': 1774780544.619551}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA11944') HTTP/1.1" 204 0
2026-03-29 10:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-29 10:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830
2026-03-29 10:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b35f96e5-5799-5631-b461-1088215b4928 with identifier: CW57830 to the API
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:24:32Z',
'fuel_type': 'diesel',
'id': 'b35f96e5-5799-5631-b461-1088215b4928',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW57830',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 157571,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-13',
'seller_name': None,
'title': 'BMW X1 sDrive 18d',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Saving data for CW57830: {'auction_closing_time': 1774884272.0, 'created_time': 1773304704.963808, 'last_price_update_time': 1774780544.943672}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW57830') HTTP/1.1" 204 0
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA77092%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Scrape type for VA77092: 2
2026-03-29 10:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c183823e-83eb-59c9-9237-b550c28219a6 with identifier: VA77092
2026-03-29 10:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c183823e-83eb-59c9-9237-b550c28219a6 with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c183823e-83eb-59c9-9237-b550c28219a6 with scrape type 2
2026-03-29 10:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c183823e-83eb-59c9-9237-b550c28219a6, identifier: VA77092
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-29 10:35:45 [auto1.de] INFO: Scrape type for YC02535: 2
2026-03-29 10:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with identifier: YC02535
2026-03-29 10:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with scrape type 2
2026-03-29 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with scrape type 2
2026-03-29 10:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97726a30-28e2-5d84-9da2-5bd149cbdbc0, identifier: YC02535
2026-03-29 10:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c183823e-83eb-59c9-9237-b550c28219a6 with identifier: VA77092
2026-03-29 10:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c183823e-83eb-59c9-9237-b550c28219a6 with identifier: VA77092
2026-03-29 10:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c183823e-83eb-59c9-9237-b550c28219a6 with identifier: VA77092 to the API
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 525,
'expiration_date': '2026-03-30T15:41:11Z',
'fuel_type': 'petrol',
'id': 'c183823e-83eb-59c9-9237-b550c28219a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA77092',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 78490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-02',
'seller_name': None,
'title': 'Land Rover Range Rover 5.0 V8 Kompressor Autobiography',
'transmission': 'automatic',
'trim': 'Autobiography',
'year': 2018}
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA77092%27 HTTP/1.1" 200 None
2026-03-29 10:35:45 [auto1.de] INFO: Saving data for VA77092: {'auction_closing_time': 1774885271.0, 'created_time': 1774465413.116247, 'last_price_update_time': 1774780545.55452}
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA77092') HTTP/1.1" 204 0
2026-03-29 10:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with identifier: YC02535
2026-03-29 10:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with identifier: YC02535
2026-03-29 10:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97726a30-28e2-5d84-9da2-5bd149cbdbc0 with identifier: YC02535 to the API
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:21:09Z',
'fuel_type': 'diesel',
'id': '97726a30-28e2-5d84-9da2-5bd149cbdbc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC02535',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 74410,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-24',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2016}
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-29 10:35:45 [auto1.de] INFO: Saving data for YC02535: {'auction_closing_time': 1774884069.0, 'created_time': 1773303466.753191, 'last_price_update_time': 1774780545.890169}
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC02535') HTTP/1.1" 204 0
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-29 10:35:45 [auto1.de] INFO: Scrape type for LW90225: 2
2026-03-29 10:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-29 10:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db9f3e6-28ca-5789-b94e-baa1365522f0 with scrape type 2
2026-03-29 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4db9f3e6-28ca-5789-b94e-baa1365522f0 with scrape type 2
2026-03-29 10:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4db9f3e6-28ca-5789-b94e-baa1365522f0, identifier: LW90225
2026-03-29 10:35:46 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-29 10:35:46 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-29 10:35:46 [auto1.de] INFO: Scrape type for TW01944: 2
2026-03-29 10:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-29 10:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fb66c5-e426-5269-adf5-0b07651470df with scrape type 2
2026-03-29 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84fb66c5-e426-5269-adf5-0b07651470df with scrape type 2
2026-03-29 10:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84fb66c5-e426-5269-adf5-0b07651470df, identifier: TW01944
2026-03-29 10:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-29 10:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225
2026-03-29 10:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4db9f3e6-28ca-5789-b94e-baa1365522f0 with identifier: LW90225 to the API
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:56:34Z',
'fuel_type': 'diesel',
'id': '4db9f3e6-28ca-5789-b94e-baa1365522f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW90225',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 180483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-08',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2015}
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-29 10:35:46 [auto1.de] INFO: Saving data for LW90225: {'auction_closing_time': 1774886194.0, 'created_time': 1773230000.780706, 'last_price_update_time': 1774780546.563028}
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW90225') HTTP/1.1" 204 0
2026-03-29 10:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-29 10:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944
2026-03-29 10:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84fb66c5-e426-5269-adf5-0b07651470df with identifier: TW01944 to the API
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:35:52Z',
'fuel_type': 'diesel',
'id': '84fb66c5-e426-5269-adf5-0b07651470df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW01944',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 183706,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-23',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-29 10:35:47 [auto1.de] INFO: Saving data for TW01944: {'auction_closing_time': 1774884952.0, 'created_time': 1773136385.76575, 'last_price_update_time': 1774780547.095679}
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW01944') HTTP/1.1" 204 0
2026-03-29 10:35:47 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-29 10:35:47 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-29 10:35:47 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-29 10:35:47 [auto1.de] INFO: Scrape type for ZA27483: 2
2026-03-29 10:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-29 10:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82144a3-7d52-5b21-9917-ad8fe8418b67 with scrape type 2
2026-03-29 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82144a3-7d52-5b21-9917-ad8fe8418b67 with scrape type 2
2026-03-29 10:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f82144a3-7d52-5b21-9917-ad8fe8418b67, identifier: ZA27483
2026-03-29 10:35:47 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-29 10:35:47 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-29 10:35:47 [auto1.de] INFO: Scrape type for HT70874: 2
2026-03-29 10:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with identifier: HT70874
2026-03-29 10:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with scrape type 2
2026-03-29 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with scrape type 2
2026-03-29 10:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb, identifier: HT70874
2026-03-29 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-29 10:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483
2026-03-29 10:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f82144a3-7d52-5b21-9917-ad8fe8418b67 with identifier: ZA27483 to the API
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:17:04Z',
'fuel_type': 'petrol',
'id': 'f82144a3-7d52-5b21-9917-ad8fe8418b67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA27483',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 50250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-11',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-29 10:35:47 [auto1.de] INFO: Saving data for ZA27483: {'auction_closing_time': 1774883824.0, 'created_time': 1773340807.798658, 'last_price_update_time': 1774780547.758162}
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA27483') HTTP/1.1" 204 0
2026-03-29 10:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with identifier: HT70874
2026-03-29 10:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with identifier: HT70874
2026-03-29 10:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb with identifier: HT70874 to the API
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:17:06Z',
'fuel_type': 'petrol',
'id': '53d341a3-e0fa-55be-8fcb-1ac7a11d3ebb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT70874',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 122003,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-27',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2017}
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-29 10:35:48 [auto1.de] INFO: Saving data for HT70874: {'auction_closing_time': 1774883826.0, 'created_time': 1773132012.51701, 'last_price_update_time': 1774780548.130342}
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT70874') HTTP/1.1" 204 0
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM73112%27 HTTP/1.1" 200 None
2026-03-29 10:35:48 [auto1.de] INFO: Scrape type for XM73112: 2
2026-03-29 10:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49616f7e-77a2-504a-8b4c-4bcd789989e2 with identifier: XM73112
2026-03-29 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49616f7e-77a2-504a-8b4c-4bcd789989e2 with scrape type 2
2026-03-29 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49616f7e-77a2-504a-8b4c-4bcd789989e2 with scrape type 2
2026-03-29 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49616f7e-77a2-504a-8b4c-4bcd789989e2, identifier: XM73112
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-29 10:35:48 [auto1.de] INFO: Scrape type for KF64937: 2
2026-03-29 10:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-29 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with scrape type 2
2026-03-29 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with scrape type 2
2026-03-29 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59, identifier: KF64937
2026-03-29 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC29911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49616f7e-77a2-504a-8b4c-4bcd789989e2 with identifier: XM73112
2026-03-29 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49616f7e-77a2-504a-8b4c-4bcd789989e2 with identifier: XM73112
2026-03-29 10:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49616f7e-77a2-504a-8b4c-4bcd789989e2 with identifier: XM73112 to the API
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:25:11Z',
'fuel_type': 'diesel',
'id': '49616f7e-77a2-504a-8b4c-4bcd789989e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM73112',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 57886,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-09',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 d Mild-Hybrid T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2022}
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM73112%27 HTTP/1.1" 200 None
2026-03-29 10:35:48 [auto1.de] INFO: Saving data for XM73112: {'auction_closing_time': 1774884311.0, 'created_time': 1774378038.153195, 'last_price_update_time': 1774780548.694256}
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM73112') HTTP/1.1" 204 0
2026-03-29 10:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-29 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937
2026-03-29 10:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0c6ebc-3f12-5971-a90e-87ceb166ad59 with identifier: KF64937 to the API
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:11:46Z',
'fuel_type': 'diesel',
'id': '3b0c6ebc-3f12-5971-a90e-87ceb166ad59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF64937',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 111148,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-25',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-29 10:35:49 [auto1.de] INFO: Saving data for KF64937: {'auction_closing_time': 1774883506.0, 'created_time': 1773226720.255274, 'last_price_update_time': 1774780549.151942}
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF64937') HTTP/1.1" 204 0
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-29 10:35:49 [auto1.de] INFO: Scrape type for XW48128: 2
2026-03-29 10:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-29 10:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54948df8-0462-5578-8152-550b90091500 with scrape type 2
2026-03-29 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54948df8-0462-5578-8152-550b90091500 with scrape type 2
2026-03-29 10:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54948df8-0462-5578-8152-550b90091500, identifier: XW48128
2026-03-29 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH10753> (referer: https://www.auto1.com/v1/car-details-view/NH10753/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-29 10:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128
2026-03-29 10:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54948df8-0462-5578-8152-550b90091500 with identifier: XW48128 to the API
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:16:49Z',
'fuel_type': 'petrol',
'id': '54948df8-0462-5578-8152-550b90091500',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW48128',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 158463,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-17',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Sports-Line',
'transmission': 'automatic',
'trim': 'Sports-Line',
'year': 2016}
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-29 10:35:49 [auto1.de] INFO: Saving data for XW48128: {'auction_closing_time': 1774883809.0, 'created_time': 1773307964.489466, 'last_price_update_time': 1774780549.633052}
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW48128') HTTP/1.1" 204 0
2026-03-29 10:35:49 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-29 10:35:49 [auto1.de] INFO: Scrape type for LT87510: 2
2026-03-29 10:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with identifier: LT87510
2026-03-29 10:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with scrape type 2
2026-03-29 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with scrape type 2
2026-03-29 10:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b, identifier: LT87510
2026-03-29 10:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with identifier: LT87510
2026-03-29 10:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with identifier: LT87510
2026-03-29 10:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b5ecb3c-8029-518f-9a06-4bf7bfd2014b with identifier: LT87510 to the API
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:33:05Z',
'fuel_type': 'diesel',
'id': '1b5ecb3c-8029-518f-9a06-4bf7bfd2014b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT87510',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 158516,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-28',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Soleil',
'transmission': 'manual',
'trim': 'Soleil',
'year': 2020}
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Saving data for LT87510: {'auction_closing_time': 1774884785.0, 'created_time': 1773302687.610415, 'last_price_update_time': 1774780550.105867}
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT87510') HTTP/1.1" 204 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for LS49952: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for EN74445: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for YL95361: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for RY86630: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for CU91826: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for YY17846: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for NB79280: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for TF22102: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for FG94497: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for LF77567: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for VJ93938: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for AX13429: 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for SD17030: 0
2026-03-29 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for WS77403: 2
2026-03-29 10:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4de303b2-f95d-55b9-b8ae-f733230eca7f with identifier: WS77403
2026-03-29 10:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4de303b2-f95d-55b9-b8ae-f733230eca7f with scrape type 2
2026-03-29 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4de303b2-f95d-55b9-b8ae-f733230eca7f with scrape type 2
2026-03-29 10:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4de303b2-f95d-55b9-b8ae-f733230eca7f, identifier: WS77403
2026-03-29 10:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4de303b2-f95d-55b9-b8ae-f733230eca7f with identifier: WS77403
2026-03-29 10:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4de303b2-f95d-55b9-b8ae-f733230eca7f with identifier: WS77403
2026-03-29 10:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4de303b2-f95d-55b9-b8ae-f733230eca7f with identifier: WS77403 to the API
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:57:08Z',
'fuel_type': 'petrol',
'id': '4de303b2-f95d-55b9-b8ae-f733230eca7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS77403',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 190808,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-10',
'seller_name': None,
'title': 'Fiat 500 0.9 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2011}
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Saving data for WS77403: {'auction_closing_time': 1774886228.0, 'created_time': 1773917590.653556, 'last_price_update_time': 1774780550.920704}
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS77403') HTTP/1.1" 204 0
2026-03-29 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with identifier: NH10753
2026-03-29 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with scrape type 1
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_53142726fc18500bf642264b60ffc972.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_53142726fc18500bf642264b60ffc972.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_fb9a280205eb011b73f51f3cc6ab8c88.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_fb9a280205eb011b73f51f3cc6ab8c88.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_21365f1bf3169a3eb85f659e2caf11ab.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_21365f1bf3169a3eb85f659e2caf11ab.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_eeb176bcd4cd299c1cc0605bbfd6d71c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_eeb176bcd4cd299c1cc0605bbfd6d71c.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_4e39f38ccf002966ef2bc9735706dc3c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_4e39f38ccf002966ef2bc9735706dc3c.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_b0ae581d18deba9ab29a3953a9f4243c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_b0ae581d18deba9ab29a3953a9f4243c.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_8bac524affe61d53eea5472316c41a6a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_8bac524affe61d53eea5472316c41a6a.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_a6ffb951dcee16ef954b01974c6e81fc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_a6ffb951dcee16ef954b01974c6e81fc.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_a16eb114c7482cbbf25e1a110ae961d7.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_a16eb114c7482cbbf25e1a110ae961d7.jpg already downloaded
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F54%252F615446b9fd347606f2277701361fbe4c%252Fpa%252FNH10753_40dffd64fe82773db23ee40c691ac771.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_40dffd64fe82773db23ee40c691ac771.jpg already downloaded
2026-03-29 10:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be, identifier: NH10753
2026-03-29 10:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:51 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [auto1.de] INFO: Scrape type for KL19595: 2
2026-03-29 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0444739-9834-5160-9ca8-8b37164649af with identifier: KL19595
2026-03-29 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0444739-9834-5160-9ca8-8b37164649af with scrape type 2
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0444739-9834-5160-9ca8-8b37164649af with scrape type 2
2026-03-29 10:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0444739-9834-5160-9ca8-8b37164649af, identifier: KL19595
2026-03-29 10:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with identifier: NH10753
2026-03-29 10:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with identifier: NH10753
2026-03-29 10:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be with identifier: NH10753 to the API
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NH10753>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:12:05Z',
'fuel_type': 'diesel',
'id': 'dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH10753',
'listing': 'auction',
'location': 'DE, Zülpich',
'make': 'Audi',
'model': 'A6',
'odometer': 173501,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_53142726fc18500bf642264b60ffc972.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_fb9a280205eb011b73f51f3cc6ab8c88.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_21365f1bf3169a3eb85f659e2caf11ab.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_eeb176bcd4cd299c1cc0605bbfd6d71c.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_4e39f38ccf002966ef2bc9735706dc3c.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_b0ae581d18deba9ab29a3953a9f4243c.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_8bac524affe61d53eea5472316c41a6a.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_a6ffb951dcee16ef954b01974c6e81fc.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_a16eb114c7482cbbf25e1a110ae961d7.jpg',
'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_40dffd64fe82773db23ee40c691ac771.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_53142726fc18500bf642264b60ffc972.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_fb9a280205eb011b73f51f3cc6ab8c88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_21365f1bf3169a3eb85f659e2caf11ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_eeb176bcd4cd299c1cc0605bbfd6d71c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_4e39f38ccf002966ef2bc9735706dc3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_b0ae581d18deba9ab29a3953a9f4243c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_8bac524affe61d53eea5472316c41a6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_a6ffb951dcee16ef954b01974c6e81fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_a16eb114c7482cbbf25e1a110ae961d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be/dc80688b-ec5d-5bc0-a8b0-3f3f375fc4be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/54/615446b9fd347606f2277701361fbe4c/pa/NH10753_40dffd64fe82773db23ee40c691ac771.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH10753%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [auto1.de] INFO: Saving data for NH10753: {'created_time': 1774780551.837278, 'last_price_update_time': 1774780551.837289, 'auction_closing_time': 1774883525.0}
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH10753') HTTP/1.1" 204 0
2026-03-29 10:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0444739-9834-5160-9ca8-8b37164649af with identifier: KL19595
2026-03-29 10:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0444739-9834-5160-9ca8-8b37164649af with identifier: KL19595
2026-03-29 10:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0444739-9834-5160-9ca8-8b37164649af with identifier: KL19595 to the API
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 510,
'expiration_date': '2026-03-30T15:05:57Z',
'fuel_type': 'petrol',
'id': 'c0444739-9834-5160-9ca8-8b37164649af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL19595',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 108515,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-22',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 63 AMG S 4Matic',
'transmission': 'automatic',
'trim': 'S 4Matic',
'year': 2021}
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Saving data for KL19595: {'auction_closing_time': 1774883157.0, 'created_time': 1774464677.199688, 'last_price_update_time': 1774780552.252296}
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL19595') HTTP/1.1" 204 0
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for YV77496: 0
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for UP55946: 0
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for YN38539: 0
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for CG08693: 0
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for LG10256: 0
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-29 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC29911> (referer: https://www.auto1.com/v1/car-details-view/RC29911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27009e62-6619-5e99-8279-38f5697c366a with identifier: RC29911
2026-03-29 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27009e62-6619-5e99-8279-38f5697c366a with scrape type 1
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27009e62-6619-5e99-8279-38f5697c366a
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_f5f33e499e1d1ef8d7edbe9612e76d7c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_f5f33e499e1d1ef8d7edbe9612e76d7c.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_4bc423c8837f7b36944dae72a51fbaf0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_4bc423c8837f7b36944dae72a51fbaf0.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_a62323664e3cb6bbefa4664d4ff27a9b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_a62323664e3cb6bbefa4664d4ff27a9b.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_9da70cf8e1e82cccda28ad09dbc3054d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_9da70cf8e1e82cccda28ad09dbc3054d.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_3563f060a1bdee16974370745677ca2d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_3563f060a1bdee16974370745677ca2d.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_0e112a70bc491d26c3cf30c0eba05eea.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_0e112a70bc491d26c3cf30c0eba05eea.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_b158609058d72fcf123579fdeeaa276f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_b158609058d72fcf123579fdeeaa276f.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_45de47a8aa615732a92e70d0f2026fa2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_45de47a8aa615732a92e70d0f2026fa2.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_dfe5e066925b12c7189458730826c88d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_dfe5e066925b12c7189458730826c88d.jpg already downloaded
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F37%252F1137506a0a9df1392b2e8b2679ebd238%252Fpa%252FRC29911_01888a4b466ab053145b3b1951384ed0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_01888a4b466ab053145b3b1951384ed0.jpg already downloaded
2026-03-29 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27009e62-6619-5e99-8279-38f5697c366a, identifier: RC29911
2026-03-29 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27009e62-6619-5e99-8279-38f5697c366a with identifier: RC29911
2026-03-29 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27009e62-6619-5e99-8279-38f5697c366a with identifier: RC29911
2026-03-29 10:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27009e62-6619-5e99-8279-38f5697c366a with identifier: RC29911 to the API
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC29911>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:39:24Z',
'fuel_type': 'diesel',
'id': '27009e62-6619-5e99-8279-38f5697c366a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC29911',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Audi',
'model': 'Q7',
'odometer': 122558,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_f5f33e499e1d1ef8d7edbe9612e76d7c.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_4bc423c8837f7b36944dae72a51fbaf0.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_a62323664e3cb6bbefa4664d4ff27a9b.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_9da70cf8e1e82cccda28ad09dbc3054d.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_3563f060a1bdee16974370745677ca2d.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_0e112a70bc491d26c3cf30c0eba05eea.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_b158609058d72fcf123579fdeeaa276f.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_45de47a8aa615732a92e70d0f2026fa2.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_dfe5e066925b12c7189458730826c88d.jpg',
'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_01888a4b466ab053145b3b1951384ed0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_f5f33e499e1d1ef8d7edbe9612e76d7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_4bc423c8837f7b36944dae72a51fbaf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_a62323664e3cb6bbefa4664d4ff27a9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_9da70cf8e1e82cccda28ad09dbc3054d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_3563f060a1bdee16974370745677ca2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_0e112a70bc491d26c3cf30c0eba05eea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_b158609058d72fcf123579fdeeaa276f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_45de47a8aa615732a92e70d0f2026fa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_dfe5e066925b12c7189458730826c88d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27009e62-6619-5e99-8279-38f5697c366a/27009e62-6619-5e99-8279-38f5697c366a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/37/1137506a0a9df1392b2e8b2679ebd238/pa/RC29911_01888a4b466ab053145b3b1951384ed0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-07-09',
'seats_number': 7,
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2015}
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29911%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Saving data for RC29911: {'created_time': 1774780554.108635, 'last_price_update_time': 1774780554.108646, 'auction_closing_time': 1774885164.0}
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC29911') HTTP/1.1" 204 0
2026-03-29 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:54 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for JF12446: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for NH81971: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for PU44230: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for ER86835: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for MA20018: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU19428%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for SU19428: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for UW74525: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for CP06642: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX40073%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for YX40073: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for LC05735: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for AW14620: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for FM78793: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for VH46900: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN75041%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for ZN75041: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for UW93361: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for YY00897: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for DE21080: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for ZP65093: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN49232%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for JN49232: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for ZT07846: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for WG75781: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for ZR25455: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for LT54057: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for VY54552: 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-29 10:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:56 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ78269%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for GJ78269: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for HW71141: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for EM69554: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU39655%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for EU39655: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for TX59054: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for RV72867: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT69734%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for XT69734: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for XF01324: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP89204%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for UP89204: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for TZ11746: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for ZK08136: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for CU27746: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for UN73859: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for VG22194: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for JT90882: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for AJ18698: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for AG68218: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for YZ27957: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for GA63896: 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for YP19468: 0
2026-03-29 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:57 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for NZ51315: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for VH44928: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for WC28645: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for LN11604: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for XR19518: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for FE98948: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for GT84792: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for GS84935: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for UK22592: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for FU28651: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for GY36946: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for PV67596: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for ET29931: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for PW13353: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for JG07802: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29433%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for RC29433: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE68062%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for YE68062: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18032%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for FV18032: 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-29 10:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:58 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [auto1.de] INFO: Scrape type for JA02220: 0
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [auto1.de] INFO: Scrape type for JN21638: 0
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [auto1.de] INFO: Scrape type for MN30127: 0
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY52280%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [auto1.de] INFO: Scrape type for AY52280: 0
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37424%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [auto1.de] INFO: Scrape type for EY37424: 0
2026-03-29 10:35:58 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT94431%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for MT94431: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96844%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for PS96844: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH90644%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for DH90644: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17903%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for JX17903: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX25429%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for NX25429: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB30616%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for FB30616: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09444%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for EM09444: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ73179%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for KJ73179: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM07579%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for VM07579: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for XH18940: 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ89172%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for UZ89172: 0
2026-03-29 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:00 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF06925%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for EF06925: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE56505%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for UE56505: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR93945%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for TR93945: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF10359%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for UF10359: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN60503%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for BN60503: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG41279%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for BG41279: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND89828%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for ND89828: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for CK62820: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for FC82221: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for MF60875: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for KT60854: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for MG42603: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for FK12887: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for CH93645: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for JP33538: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for YT05280: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for RF07068: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for MU49508: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for KD86114: 0
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for EF75873: 0
2026-03-29 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:01 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for HZ55109: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for UR98067: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for CX74060: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for LA18154: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for CW95568: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for GD26044: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for EE96817: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for NH06338: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for MF86039: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for SJ64604: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for DT57257: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for VT63649: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for JX79740: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for FR69109: 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for BS19118: 0
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for SL92984: 0
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for GH39731: 0
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for SN42334: 0
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for NV30450: 0
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for ZW50012: 0
2026-03-29 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:03 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for AB49133: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for KB67170: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for KF93262: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for BP80209: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for FR18143: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for WF13702: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for HH06006: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for LU46217: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for DC32299: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for ZM10504: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for NA60022: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for CH24864: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for AK26500: 0
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-29 10:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:04 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for JL32962: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for UN88738: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for TV18525: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for MU81714: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for ZL07582: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for PW12377: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for RD52099: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for CX30934: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for KT37105: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for SS07399: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for RR54011: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for JL12737: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for KP96972: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for YW59624: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for NX68514: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for DW75956: 0
2026-03-29 10:36:04 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-29 10:36:04 [auto1.de] INFO: Scrape type for DS69815: 0
2026-03-29 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:05 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:05 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-29 10:36:05 [auto1.de] INFO: Scrape type for AR05539: 0
2026-03-29 10:36:05 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-29 10:36:05 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-29 10:36:05 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for TF63689: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for YD12579: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for NU91903: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for BE44691: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for ZK29983: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for FC63717: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for UP80660: 0
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-29 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:06 [scrapy.extensions.logstats] INFO: Crawled 89 pages (at 29 pages/min), scraped 238 items (at 82 items/min)
2026-03-29 10:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:07 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-29 10:36:07 [auto1.de] INFO: Scrape type for TU49821: 0
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-29 10:36:07 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-29 10:36:07 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for JE51939: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for CR11100: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for WN56158: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for KC39120: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for LM88961: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for AN54197: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for HW22525: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for UY73943: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for TN59671: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for YS06113: 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for VX34650: 0
2026-03-29 10:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:09 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for JN76212: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for TF08287: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for TU29288: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for MG37810: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for BY58400: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for DJ32425: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for DV41377: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-29 10:36:10 [auto1.de] INFO: Scrape type for ZM52655: 0
2026-03-29 10:36:10 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-29 10:36:10 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-29 10:36:10 [auto1.de] INFO: Scrape type for BB33034: 0
2026-03-29 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:11 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for JV22464: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for GY48177: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for XM82116: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for SZ74678: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for SV18867: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for SL47086: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for EJ65167: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for JR97371: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for VS79881: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for MF41784: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for SC06812: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for RY72669: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for FK00341: 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-29 10:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:12 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-29 10:36:12 [auto1.de] INFO: Scrape type for LE46493: 0
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-29 10:36:12 [auto1.de] INFO: Scrape type for MX26895: 2
2026-03-29 10:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-29 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5927c0-898e-5593-b49f-51055df7b7c2 with scrape type 2
2026-03-29 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f5927c0-898e-5593-b49f-51055df7b7c2 with scrape type 2
2026-03-29 10:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f5927c0-898e-5593-b49f-51055df7b7c2, identifier: MX26895
2026-03-29 10:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 10:36:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-29 10:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895 to the API
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:32:10Z',
'fuel_type': 'petrol',
'id': '7f5927c0-898e-5593-b49f-51055df7b7c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX26895',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 38040,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-07',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Perfect',
'transmission': 'manual',
'trim': 'Perfect',
'year': 2018}
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Saving data for MX26895: {'auction_closing_time': 1774884730.0, 'created_time': 1774596636.931782, 'last_price_update_time': 1774780573.607198}
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX26895') HTTP/1.1" 204 0
2026-03-29 10:36:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for LT72401: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for LJ65077: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for SB37681: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for HJ62454: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for PD80009: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for EF82631: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for PL48246: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for BZ96817: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for GE94001: 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for CM83282: 2
2026-03-29 10:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-29 10:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293678e2-a396-5cd4-bdb2-d1c75c6781fc with scrape type 2
2026-03-29 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293678e2-a396-5cd4-bdb2-d1c75c6781fc with scrape type 2
2026-03-29 10:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 293678e2-a396-5cd4-bdb2-d1c75c6781fc, identifier: CM83282
2026-03-29 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-29 10:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-29 10:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282 to the API
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:22:24Z',
'fuel_type': 'petrol',
'id': '293678e2-a396-5cd4-bdb2-d1c75c6781fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM83282',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 154492,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-08-25',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Classic',
'transmission': 'automatic',
'trim': 'T Classic',
'year': 2002}
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Saving data for CM83282: {'auction_closing_time': 1774884144.0, 'created_time': 1773301389.161036, 'last_price_update_time': 1774780574.449067}
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM83282') HTTP/1.1" 204 0
2026-03-29 10:36:14 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-29 10:36:14 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-29 10:36:14 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-29 10:36:14 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-29 10:36:14 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Scrape type for RS52465: 0
2026-03-29 10:36:14 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-29 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:15 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for XW85438: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for GJ72633: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for WE78461: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for BB70854: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for ZM17001: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for KF91285: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for DF17432: 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Scrape type for EN46705: 0
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Scrape type for WA68072: 0
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Scrape type for JV32404: 0
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Scrape type for LC33794: 0
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-29 10:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:17 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for HP02844: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for JY04435: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for RD63050: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for RM28655: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for KC35382: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for WG70910: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for LB57303: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for VY38504: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for JH21308: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for TB88794: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for FA01437: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for BB54670: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for XY94981: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for DB25597: 0
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-29 10:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:18 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for YZ38333: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for GG14507: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for VG84958: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for EH25554: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for JT97344: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for WG00954: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for HJ54596: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for SK99321: 2
2026-03-29 10:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-29 10:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with scrape type 2
2026-03-29 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with scrape type 2
2026-03-29 10:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5d6bc21-c8bc-5975-8fdd-379adbd8b706, identifier: SK99321
2026-03-29 10:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-29 10:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-29 10:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321 to the API
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:04:14Z',
'fuel_type': 'diesel',
'id': 'e5d6bc21-c8bc-5975-8fdd-379adbd8b706',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK99321',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 375931,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-19',
'seller_name': None,
'title': 'Mercedes-Benz Viano 3.0 CDI lang Trend',
'transmission': 'automatic',
'trim': 'lang Trend',
'year': 2007}
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [auto1.de] INFO: Saving data for SK99321: {'auction_closing_time': 1774883054.0, 'created_time': 1773916765.89427, 'last_price_update_time': 1774780579.495489}
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK99321') HTTP/1.1" 204 0
2026-03-29 10:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:19 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-29 10:36:19 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [auto1.de] INFO: Scrape type for HJ11294: 0
2026-03-29 10:36:19 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-29 10:36:19 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-29 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:20 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for SL53901: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for DW94281: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for VD47640: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for UV26569: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for KV36004: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for TH75068: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for JZ96778: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-29 10:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:21 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:21 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-29 10:36:21 [auto1.de] INFO: Scrape type for CF84548: 0
2026-03-29 10:36:21 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for HE96933: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for JD70113: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for TD06456: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for XT71149: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for JV77194: 2
2026-03-29 10:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-29 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466b1101-b58d-541b-a86a-2c83fdd7efd2 with scrape type 2
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466b1101-b58d-541b-a86a-2c83fdd7efd2 with scrape type 2
2026-03-29 10:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 466b1101-b58d-541b-a86a-2c83fdd7efd2, identifier: JV77194
2026-03-29 10:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-29 10:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-29 10:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194 to the API
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:52:16Z',
'fuel_type': 'diesel',
'id': '466b1101-b58d-541b-a86a-2c83fdd7efd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV77194',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 184714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-02',
'seller_name': None,
'title': 'BMW 5er 530d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Saving data for JV77194: {'auction_closing_time': 1774885936.0, 'created_time': 1773429144.839416, 'last_price_update_time': 1774780582.745813}
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV77194') HTTP/1.1" 204 0
2026-03-29 10:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for DG73044: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for XN26589: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: US43373
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for SA82608: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for WG96363: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for ZC62608: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for CP99772: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-29 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:24 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for VJ44121: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for SY16661: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for PW56805: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for GF62239: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for EL73218: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for BV55429: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for EC33073: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for ZW06761: 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-29 10:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:25 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for KS23837: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for CR29385: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Scrape type for SS89253: 0
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Scrape type for HV14674: 0
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Scrape type for AE42693: 0
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Scrape type for DN26053: 0
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Scrape type for PC60624: 0
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-29 10:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:27 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for VB62953: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for WS48624: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for LC91854: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for SY85938: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for UB45914: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for ZM88975: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for WN92632: 0
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for LJ18760: 2
2026-03-29 10:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-29 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf327d3-7715-5496-9bd5-cef1eef3ec2f with scrape type 2
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf327d3-7715-5496-9bd5-cef1eef3ec2f with scrape type 2
2026-03-29 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf327d3-7715-5496-9bd5-cef1eef3ec2f, identifier: LJ18760
2026-03-29 10:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-29 10:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-29 10:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760 to the API
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:56Z',
'fuel_type': 'petrol',
'id': 'faf327d3-7715-5496-9bd5-cef1eef3ec2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ18760',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 50564,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-08',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Trend 2WD',
'transmission': 'automatic',
'trim': 'Trend 2WD',
'year': 2023}
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Saving data for LJ18760: {'auction_closing_time': 1774883816.0, 'created_time': 1774596634.790609, 'last_price_update_time': 1774780587.951534}
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ18760') HTTP/1.1" 204 0
2026-03-29 10:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Scrape type for EU98596: 0
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Scrape type for YH81029: 0
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-29 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:29 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for FD81187: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for TD54604: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for JM39243: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for VH61709: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for SG95649: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for RG01801: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for YA93761: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for GS69685: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for SD97689: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for ZJ78917: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for SG28437: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-29 10:36:29 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-29 10:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:30 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for AA51921: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for HT62005: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for LU00556: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for NM84530: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for NX86319: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for KY27003: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for WZ51755: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for XV87595: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-29 10:36:31 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-29 10:36:31 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-29 10:36:31 [auto1.de] INFO: Scrape type for KR20197: 0
2026-03-29 10:36:31 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-29 10:36:31 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-29 10:36:31 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-29 10:36:31 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-29 10:36:31 [auto1.de] INFO: Scrape type for NT47170: 0
2026-03-29 10:36:31 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-29 10:36:31 [auto1.de] INFO: Scrape type for CC55438: 2
2026-03-29 10:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-29 10:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46770eb6-9132-56e6-876b-f993d53b14dd with scrape type 2
2026-03-29 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46770eb6-9132-56e6-876b-f993d53b14dd with scrape type 2
2026-03-29 10:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46770eb6-9132-56e6-876b-f993d53b14dd, identifier: CC55438
2026-03-29 10:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-29 10:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-29 10:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438 to the API
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:19:58Z',
'fuel_type': 'diesel',
'id': '46770eb6-9132-56e6-876b-f993d53b14dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC55438',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 118261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-10',
'seller_name': None,
'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
'transmission': 'automatic',
'trim': 'Overland',
'year': 2016}
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [auto1.de] INFO: Saving data for CC55438: {'auction_closing_time': 1774883998.0, 'created_time': 1773302092.419733, 'last_price_update_time': 1774780592.121838}
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC55438') HTTP/1.1" 204 0
2026-03-29 10:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:32 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-29 10:36:32 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-29 10:36:32 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-29 10:36:32 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-29 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:33 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for RN81514: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for GY96570: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for UC60552: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for DX68266: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for FY99153: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for MM43491: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for SA10285: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for PG24864: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for FN00007: 2
2026-03-29 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-29 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with scrape type 2
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with scrape type 2
2026-03-29 10:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd, identifier: FN00007
2026-03-29 10:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-29 10:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-29 10:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007 to the API
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:45:59Z',
'fuel_type': 'petrol',
'id': '4c592b64-a120-5bf8-a3f5-8bb368b63cdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN00007',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 99371,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-29',
'seller_name': None,
'title': 'Abarth 595 1.4 Competizione',
'transmission': 'manual',
'trim': 'Competizione',
'year': 2013}
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Saving data for FN00007: {'auction_closing_time': 1774885559.0, 'created_time': 1774596643.906591, 'last_price_update_time': 1774780593.957094}
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN00007') HTTP/1.1" 204 0
2026-03-29 10:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Scrape type for LY63644: 0
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Scrape type for ES42650: 0
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Scrape type for UE61705: 0
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Scrape type for XR74072: 2
2026-03-29 10:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-29 10:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90000786-ff54-5003-9562-f8ca4daaf791 with scrape type 2
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90000786-ff54-5003-9562-f8ca4daaf791 with scrape type 2
2026-03-29 10:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90000786-ff54-5003-9562-f8ca4daaf791, identifier: XR74072
2026-03-29 10:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-29 10:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-29 10:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072 to the API
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:42:53Z',
'fuel_type': 'petrol',
'id': '90000786-ff54-5003-9562-f8ca4daaf791',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR74072',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 193477,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-08',
'seller_name': None,
'title': 'Skoda Fabia 1.6 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Saving data for XR74072: {'auction_closing_time': 1774885373.0, 'created_time': 1773400675.632472, 'last_price_update_time': 1774780594.661238}
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR74072') HTTP/1.1" 204 0
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-29 10:36:34 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Scrape type for SF00681: 0
2026-03-29 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:35 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:35 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-29 10:36:35 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-29 10:36:35 [auto1.de] INFO: Scrape type for ZE41577: 0
2026-03-29 10:36:35 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-29 10:36:35 [auto1.de] INFO: Scrape type for SA81936: 2
2026-03-29 10:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-29 10:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6543a61-abaf-57bc-85f3-6e55a931f1c1 with scrape type 2
2026-03-29 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6543a61-abaf-57bc-85f3-6e55a931f1c1 with scrape type 2
2026-03-29 10:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6543a61-abaf-57bc-85f3-6e55a931f1c1, identifier: SA81936
2026-03-29 10:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-29 10:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-29 10:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936 to the API
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:22:48Z',
'fuel_type': 'diesel',
'id': 'c6543a61-abaf-57bc-85f3-6e55a931f1c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA81936',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 189681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-28',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline 4Motion BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline 4Motion BlueMotion',
'year': 2013}
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Saving data for SA81936: {'auction_closing_time': 1774884168.0, 'created_time': 1773945848.929467, 'last_price_update_time': 1774780596.299069}
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA81936') HTTP/1.1" 204 0
2026-03-29 10:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for JE00015: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for UM95943: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for ZS46633: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for JS64432: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: US49854
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for UD14847: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for NZ32972: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for ZB74366: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for XR26970: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for VU33733: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for TU08005: 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-29 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:37 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for NR35268: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for ML06015: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for TV18739: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for EE77460: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for KS26285: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for EG39650: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for XF55006: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for KH46132: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for AF88464: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Scrape type for AA46272: 0
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Scrape type for XG77480: 0
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Scrape type for AM78577: 0
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Scrape type for FR92717: 0
2026-03-29 10:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:39 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for PW12132: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for NT04254: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for GV91786: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for JV68921: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for FP33840: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for FE12352: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for GH02109: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for LM10122: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for ZE40568: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for VU50436: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for HG45518: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for HB62696: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for RE17232: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for GJ82118: 0
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-29 10:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:40 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for KE52706: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for FK87284: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for VX13516: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for JN34969: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for XZ94866: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for KK19800: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for DV91076: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for EW47494: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for KX50860: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for LK12001: 0
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for GH47357: 0
2026-03-29 10:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:41 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [auto1.de] INFO: Scrape type for RU25678: 0
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [auto1.de] INFO: Scrape type for GV09290: 0
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for KL90594: 0
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for DX01657: 0
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for CP43977: 2
2026-03-29 10:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-29 10:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3abc42d-c754-5492-9a97-637e58f44563 with scrape type 2
2026-03-29 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3abc42d-c754-5492-9a97-637e58f44563 with scrape type 2
2026-03-29 10:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3abc42d-c754-5492-9a97-637e58f44563, identifier: CP43977
2026-03-29 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-29 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-29 10:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977 to the API
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:40:41Z',
'fuel_type': 'diesel',
'id': 'f3abc42d-c754-5492-9a97-637e58f44563',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP43977',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 230472,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-30',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2014}
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Saving data for CP43977: {'auction_closing_time': 1774885241.0, 'created_time': 1774596638.895696, 'last_price_update_time': 1774780603.038428}
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP43977') HTTP/1.1" 204 0
2026-03-29 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Scrape type for DT77440: 0
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Scrape type for KM87247: 0
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-29 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:44 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for KR04535: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for YN10477: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for KV78740: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for WP28886: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for AB87355: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for ZD28576: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for BA95413: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for FB31140: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for XL62342: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for WV94095: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for MZ72792: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for HB06049: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for PD00543: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for BJ60837: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for DU27539: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for LJ93781: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for RN03307: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-29 10:36:44 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-29 10:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:45 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for NN66597: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for JR17780: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for WY54008: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for GV91046: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for ED00109: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for RZ48384: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for SB60272: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for TN32015: 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Scrape type for XY68410: 0
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Scrape type for DA23811: 0
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Scrape type for DZ79939: 0
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Scrape type for TD17986: 0
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Scrape type for AS21942: 0
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Scrape type for XS38036: 0
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Scrape type for RV99753: 0
2026-03-29 10:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:47 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for MB94614: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for DT00101: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for HS55483: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for BR02307: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for DF30572: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for PJ17742: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for FK97856: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for DF02739: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for CL06528: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for VK94352: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for UC38867: 0
2026-03-29 10:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:48 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-29 10:36:48 [auto1.de] INFO: Scrape type for HH61225: 0
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-29 10:36:48 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-29 10:36:48 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for NR64586: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for GC11605: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for FM53272: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for UL70410: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for EB33579: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for UZ81937: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for AZ05535: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for DW36097: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for MC22222: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for UB34830: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-29 10:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:50 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for KX26949: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for RN18911: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for VW82123: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for JJ95706: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for DD89889: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for UA36533: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for AX51342: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for YJ71992: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for XN70423: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for FG50189: 0
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-29 10:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:51 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-29 10:36:51 [auto1.de] INFO: Scrape type for ZA19141: 0
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-29 10:36:51 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-29 10:36:51 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-29 10:36:51 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-29 10:36:51 [auto1.de] INFO: Scrape type for WJ04835: 0
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for MA41049: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for AV25336: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for ER78775: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for LT09542: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for VY61993: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for MU33695: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for HJ54097: 2
2026-03-29 10:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-29 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with scrape type 2
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with scrape type 2
2026-03-29 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0, identifier: HJ54097
2026-03-29 10:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-29 10:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-29 10:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097 to the API
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:02:16Z',
'fuel_type': 'diesel',
'id': 'feb9fca7-2a53-576c-8be8-d54e3e6a1ac0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ54097',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 135026,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-17',
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-29 10:36:53 [auto1.de] INFO: Saving data for HJ54097: {'auction_closing_time': 1774882936.0, 'created_time': 1774596634.348199, 'last_price_update_time': 1774780613.321584}
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ54097') HTTP/1.1" 204 0
2026-03-29 10:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:53 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-29 10:36:53 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-29 10:36:53 [auto1.de] INFO: Scrape type for HA10430: 0
2026-03-29 10:36:53 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-29 10:36:53 [auto1.de] INFO: Scrape type for RY91957: 0
2026-03-29 10:36:53 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-29 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:54 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for KG08192: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for TE32041: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for HX34455: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for HX00306: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for AR62221: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for CY90259: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for BZ09697: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for GC82813: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for PL23541: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for ND33880: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for AB26225: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for SC70285: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for XB46016: 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for BX34768: 2
2026-03-29 10:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-29 10:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17183509-0640-5e2d-ad31-9488c283422e with scrape type 2
2026-03-29 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17183509-0640-5e2d-ad31-9488c283422e with scrape type 2
2026-03-29 10:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17183509-0640-5e2d-ad31-9488c283422e, identifier: BX34768
2026-03-29 10:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-29 10:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-29 10:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768 to the API
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:53:40Z',
'fuel_type': 'petrol',
'id': '17183509-0640-5e2d-ad31-9488c283422e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX34768',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 16740,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-14',
'seller_name': None,
'title': 'Fiat 500 1.2 Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2018}
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-29 10:36:55 [auto1.de] INFO: Saving data for BX34768: {'auction_closing_time': 1774886020.0, 'created_time': 1774349465.328535, 'last_price_update_time': 1774780615.430396}
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX34768') HTTP/1.1" 204 0
2026-03-29 10:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:55 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-29 10:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:56 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for FG09102: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for YF25460: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for KE90255: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for KJ55573: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for XK87583: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for YD46257: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for TA14554: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for PG30420: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-29 10:36:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:58 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for RH04581: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for XD11713: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for NW35011: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for GF78107: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for CG74532: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for SM47095: 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for SD86365: 0
2026-03-29 10:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:59 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for SZ48596: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for YE46941: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for WM09546: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for GJ62462: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for DS71504: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for WE79254: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for TY75534: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for YT16808: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for AW88722: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for ZJ19484: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for AP34925: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for CD75324: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for ZY62714: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for HP95404: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-29 10:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:00 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-29 10:37:00 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for SR08314: 0
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for BB98458: 0
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for PY88123: 0
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for ZV84359: 0
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for DF95353: 0
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for AB88110: 0
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-29 10:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:02 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for PM23375: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for HR10791: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for BW77657: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for NK83819: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for ZZ59930: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for HH56316: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for LX86336: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for XF83287: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for YT57989: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for JS13151: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for NF38330: 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-29 10:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:03 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for BN76417: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for ZS47676: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for CM15300: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for EC93517: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for YN35790: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for LT29180: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Scrape type for AW08292: 0
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-29 10:37:03 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for VC63070: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for TF71705: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for BT97147: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for WT86563: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for PS47170: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for AG08443: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for YJ47814: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-29 10:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:05 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for KR99013: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for VB93359: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for AL45510: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for AK65785: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for YH76604: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for EG34201: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for AW17852: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for AY57435: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for BD44201: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Scrape type for NG07529: 0
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-29 10:37:05 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-29 10:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:06 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for LR76257: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for DC50657: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for UX10113: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for YF78558: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for MS73974: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for XE26333: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for EL91395: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for KN65444: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for EB01944: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-29 10:37:07 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-29 10:37:07 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-29 10:37:07 [auto1.de] INFO: Scrape type for NJ99986: 0
2026-03-29 10:37:07 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-29 10:37:07 [auto1.de] INFO: Scrape type for KM66171: 0
2026-03-29 10:37:07 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-29 10:37:07 [auto1.de] INFO: Scrape type for TU73668: 0
2026-03-29 10:37:07 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-29 10:37:07 [auto1.de] INFO: Scrape type for PT08625: 0
2026-03-29 10:37:07 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-29 10:37:07 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-29 10:37:07 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-29 10:37:07 [scrapy.extensions.logstats] INFO: Crawled 124 pages (at 35 pages/min), scraped 250 items (at 12 items/min)
2026-03-29 10:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:08 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for ZR39643: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for PJ34004: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for JL65692: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for LK79875: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for AG47249: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for XB43693: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Scrape type for HS53864: 0
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Scrape type for EU79634: 0
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Scrape type for RR35143: 0
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Scrape type for XW28946: 0
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Scrape type for KJ96980: 0
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-29 10:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:10 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for GE03555: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for LM98964: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for BJ98180: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for PY37454: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for RZ53370: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for PN22226: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for GU43225: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for JS31219: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for WG78869: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for TF26076: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for NR99017: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for VG31593: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-29 10:37:10 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-29 10:37:10 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-29 10:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:11 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for ZT19745: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for KN67174: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for EX72807: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for AH65179: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: US78573
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Scrape type for NP24686: 0
2026-03-29 10:37:11 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-29 10:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:13 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for NR67134: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for AA40394: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for WD77905: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for XN62659: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for HW81308: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for RJ76690: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for AU22690: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for CC81369: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for RP88862: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for HJ55484: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for BK33721: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for ZT00838: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for GC03067: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for LW48006: 0
2026-03-29 10:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:14 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for VL45063: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for FX88340: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for DF33717: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for RJ96114: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for MP68485: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-29 10:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:16 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for KR34750: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: US02373
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for US02373: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for WK90635: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for XY67074: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for ZW22458: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for XT00440: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for DL51973: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for CG27437: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for RM91715: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for VJ30367: 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for BC27569: 0
2026-03-29 10:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:23 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-29 10:37:23 [auto1.de] INFO: Scrape type for JT94626: 0
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-29 10:37:23 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-29 10:37:23 [auto1.de] INFO: Scrape type for MH82914: 0
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-29 10:37:23 [auto1.de] INFO: Scrape type for UZ08427: 2
2026-03-29 10:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-29 10:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60d5584a-3b51-5607-b3a2-191fc05a1394 with scrape type 2
2026-03-29 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60d5584a-3b51-5607-b3a2-191fc05a1394 with scrape type 2
2026-03-29 10:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60d5584a-3b51-5607-b3a2-191fc05a1394, identifier: UZ08427
2026-03-29 10:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-29 10:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-29 10:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427 to the API
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:30:53Z',
'fuel_type': 'diesel',
'id': '60d5584a-3b51-5607-b3a2-191fc05a1394',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ08427',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 187727,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-24',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2012}
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Saving data for UZ08427: {'auction_closing_time': 1774884653.0, 'created_time': 1773662188.403387, 'last_price_update_time': 1774780644.730761}
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ08427') HTTP/1.1" 204 0
2026-03-29 10:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for YG83893: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for WJ12441: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: US46384
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for XB85584: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for RA04600: 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-29 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:26 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for BN16879: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for WR53064: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for YH66607: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for MC56654: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for BD12559: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for CY56514: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for UY95441: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for SC10304: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for HZ88582: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for XX83628: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: US51436
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for EB22696: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for NC35007: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for YT04304: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-29 10:37:26 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Scrape type for SW44796: 0
2026-03-29 10:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:27 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for WP48150: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for XM92815: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for GE16975: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for KP27245: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for FJ40863: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for YM46431: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for EH98635: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for ZK30866: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for SA06109: 0
2026-03-29 10:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:29 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for VA96509: 0
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for LV46830: 0
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for HU76899: 0
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for NB74696: 2
2026-03-29 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-29 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with scrape type 2
2026-03-29 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with scrape type 2
2026-03-29 10:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd, identifier: NB74696
2026-03-29 10:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-29 10:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-29 10:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696 to the API
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:55:32Z',
'fuel_type': 'petrol',
'id': '96c7d80f-7dff-543d-8ffb-1ac5b324f0bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB74696',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 158883,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-12',
'seller_name': None,
'title': 'Dacia Sandero 1.6 Stepway II',
'transmission': 'manual',
'trim': 'Stepway II',
'year': 2012}
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Saving data for NB74696: {'auction_closing_time': 1774886132.0, 'created_time': 1773427849.428619, 'last_price_update_time': 1774780649.870012}
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB74696') HTTP/1.1" 204 0
2026-03-29 10:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for XM85964: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for DW20402: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for RJ05854: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for LZ09190: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for AU06034: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-29 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:31 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for KG01306: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for GW76676: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for NZ56847: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for VS80969: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for LS36397: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for PF67152: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU69669%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for YU69669: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for XR25495: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for MB36683: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for AK97582: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for CM72901: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-29 10:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:32 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for SC48990: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for ZF45936: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for EV39961: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for GK14526: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for VY10701: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for DJ74169: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for AF42457: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for AD28287: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for TN14580: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for FY25163: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for SC26693: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for GB74339: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for AR53020: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for WY91699: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for HG94589: 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-29 10:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:35 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for BB27376: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for XU64075: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for TL87064: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for AR55742: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for BK59777: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for HF06660: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for CT00605: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for PZ11168: 0
2026-03-29 10:37:35 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-29 10:37:35 [auto1.de] INFO: Scrape type for WE44185: 0
2026-03-29 10:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:36 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for ZG00412: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for UZ37067: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for SL27608: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for JA27410: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for VR34423: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for UZ18000: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for UK70882: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for SP10059: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for VN46305: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for TJ16115: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for JK31212: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for SM03586: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-29 10:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:37 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:37 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-29 10:37:37 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for XJ26035: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for GH26905: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for FE22716: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for YN77653: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for ZU59417: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for CS57817: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for DD95746: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for PN07086: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for RV27706: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for ZK33939: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for SA17140: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for HE21190: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: US71241
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for US71241: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-29 10:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:39 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for YY49162: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for JR21224: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for DF59303: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for VW56389: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for JY33610: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for HM04457: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for EN90928: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for KG29776: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for CK79873: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for LH09734: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for XL73598: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for YA77478: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-29 10:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:40 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for BW33957: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for ZU42459: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for YD60070: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for CA27289: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for ZF67159: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for CW80278: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for LW43520: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for WR99181: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for XD58993: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for ME12043: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for SD97280: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for BP02747: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for BT37883: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for ST29936: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-29 10:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:42 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for FV26342: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for UV59464: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for GS49465: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for TU97792: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for MA44978: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for VG52113: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for CX62190: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for HE92439: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for MM36361: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for SH26484: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for VH62706: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for NZ04570: 0
2026-03-29 10:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:44 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for BN48826: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for FC29722: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for EB96923: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for WL56832: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for MR61415: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for SA01659: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for LK29782: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for HD39951: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for EV99140: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for EW54456: 2
2026-03-29 10:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-29 10:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6160e90-c6a5-5203-af51-5018a4498b33 with scrape type 2
2026-03-29 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6160e90-c6a5-5203-af51-5018a4498b33 with scrape type 2
2026-03-29 10:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6160e90-c6a5-5203-af51-5018a4498b33, identifier: EW54456
2026-03-29 10:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-29 10:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-29 10:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456 to the API
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:08:28Z',
'fuel_type': 'diesel',
'id': 'a6160e90-c6a5-5203-af51-5018a4498b33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW54456',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 66825,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-24',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T 4Matic Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic Avantgarde',
'year': 2023}
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Saving data for EW54456: {'auction_closing_time': 1774883308.0, 'created_time': 1773341498.245972, 'last_price_update_time': 1774780664.996907}
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW54456') HTTP/1.1" 204 0
2026-03-29 10:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for GM15631: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for EW11176: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for GK51404: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-29 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:46 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for PC09309: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for LG80642: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for MC04391: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for KE01468: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for PS82171: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for TK34912: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-29 10:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:47 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for EU22008: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for KF55313: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for UW00779: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for CE41516: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for PW82194: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for HT39177: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for FP35448: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for JU23189: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for PC18756: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-29 10:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:48 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for YT48598: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for FC76019: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for ET07412: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for XC17243: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for BL84965: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for JC65588: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for ZH21180: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for MD20057: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for EC25925: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for FL94183: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for DE69910: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for EU24195: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for NT60185: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for RT01969: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for ZV29308: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for SX60280: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-29 10:37:49 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-29 10:37:49 [auto1.de] INFO: Scrape type for DE42625: 0
2026-03-29 10:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:50 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for HF86895: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for SA50642: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for GM47642: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for ZU26768: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for YT53234: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for WS02654: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-29 10:37:50 [auto1.de] INFO: Scrape type for PF97511: 0
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-29 10:37:50 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-29 10:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:52 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for DD70281: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for PE91450: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for VS10261: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for NG44703: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for SZ55877: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for AK43100: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for SR59541: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for GJ71722: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for NY67891: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for SU06279: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for HW53715: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-29 10:37:52 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-29 10:37:52 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-29 10:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:53 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for HR44152: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for AA30425: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for AB14083: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for KT10840: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for JK17459: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-29 10:37:53 [auto1.de] INFO: Scrape type for AK58988: 0
2026-03-29 10:37:53 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-29 10:37:54 [auto1.de] INFO: Scrape type for ZN63350: 0
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-29 10:37:54 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-29 10:37:54 [auto1.de] INFO: Scrape type for TE39343: 0
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-29 10:37:54 [auto1.de] INFO: Scrape type for PP85770: 0
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-29 10:37:54 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-29 10:37:54 [auto1.de] INFO: Scrape type for AH71943: 0
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-29 10:37:54 [auto1.de] INFO: Scrape type for VY07286: 0
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-29 10:37:54 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-29 10:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:55 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for MG63340: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for UE11202: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for HU16718: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for ZJ39351: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for HZ19691: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for RR18814: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for LC91411: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for NA53807: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-29 10:37:55 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-29 10:37:55 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-29 10:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:56 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for XU28434: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for KL26301: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for FF92976: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for BV74864: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for BN30919: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for GS36326: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for TV33488: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for DF38507: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for FD55088: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for ZD02189: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for XX76692: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for SJ47682: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for JT24059: 0
2026-03-29 10:37:56 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-29 10:37:56 [auto1.de] INFO: Scrape type for CW96119: 0
2026-03-29 10:37:57 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-29 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-29 10:37:57 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-29 10:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:58 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for AU29418: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for VH78915: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for AL51386: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for BR96483: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for JD98482: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for LL88784: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for VE44500: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for NR72053: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for HK68029: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for WP61796: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for VZ19342: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-29 10:37:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:00 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for KY92219: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for GH57189: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for AU27688: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for EN93789: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for HK20534: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for UA00536: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for BB78660: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for YA95886: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for TL72332: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for LC37503: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for AB73354: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for ZN20945: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for ZT78140: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for DW68578: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for WW16724: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for JT86021: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for MY70814: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for PJ38214: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-29 10:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:01 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for SE52893: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for CT44889: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for KL19137: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for WC63339: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-29 10:38:01 [auto1.de] INFO: Scrape type for YJ03455: 0
2026-03-29 10:38:01 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-29 10:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:02 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for PZ40966: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for MV46012: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for WF56073: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for WF31302: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for GP68218: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for TP00598: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for XB50161: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for NF34057: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for WY73016: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for EJ80862: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for ZV33449: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-29 10:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:04 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for GK43362: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for ET35150: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for WS02487: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for CW19006: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for NV33173: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for SA55190: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for PF96299: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for EZ94089: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for KU16473: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for JX40120: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-29 10:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:05 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for PL78300: 0
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for ES44709: 0
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for YE69852: 0
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for GM59339: 0
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for PT90816: 0
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for VS72441: 0
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-29 10:38:05 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-29 10:38:05 [auto1.de] INFO: Scrape type for ND35935: 2
2026-03-29 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-29 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce2bcd0-b987-5a99-9176-b8215ece91e0 with scrape type 2
2026-03-29 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cce2bcd0-b987-5a99-9176-b8215ece91e0 with scrape type 2
2026-03-29 10:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cce2bcd0-b987-5a99-9176-b8215ece91e0, identifier: ND35935
2026-03-29 10:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-29 10:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-29 10:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935 to the API
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 275,
'expiration_date': '2026-03-30T15:42:05Z',
'fuel_type': 'diesel',
'id': 'cce2bcd0-b987-5a99-9176-b8215ece91e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND35935',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 107273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-09',
'seller_name': None,
'title': 'Jaguar XF 3.0 D V6 S Portfolio',
'transmission': 'automatic',
'trim': 'S Portfolio',
'year': 2010}
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Saving data for ND35935: {'auction_closing_time': 1774885325.0, 'created_time': 1772545135.017775, 'last_price_update_time': 1774780687.877723}
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND35935') HTTP/1.1" 204 0
2026-03-29 10:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for AM19734: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for MA76308: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for LX22574: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-29 10:38:08 [scrapy.extensions.logstats] INFO: Crawled 157 pages (at 33 pages/min), scraped 254 items (at 4 items/min)
2026-03-29 10:38:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:09 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for DJ81890: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for AD30182: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for LV52918: 2
2026-03-29 10:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-29 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2baa4285-e073-519c-a5e2-270229ff350c with scrape type 2
2026-03-29 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2baa4285-e073-519c-a5e2-270229ff350c with scrape type 2
2026-03-29 10:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2baa4285-e073-519c-a5e2-270229ff350c, identifier: LV52918
2026-03-29 10:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-29 10:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-29 10:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918 to the API
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:22:59Z',
'fuel_type': 'petrol',
'id': '2baa4285-e073-519c-a5e2-270229ff350c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV52918',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 174982,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-21',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Joy',
'transmission': 'automatic',
'trim': 'Joy',
'year': 2016}
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Saving data for LV52918: {'auction_closing_time': 1774884179.0, 'created_time': 1773136024.566533, 'last_price_update_time': 1774780689.738237}
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV52918') HTTP/1.1" 204 0
2026-03-29 10:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for PW08848: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for CK27476: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for TY58494: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for UM48488: 2
2026-03-29 10:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-29 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79273a23-7734-5ce5-82b7-37bfab0638e7 with scrape type 2
2026-03-29 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79273a23-7734-5ce5-82b7-37bfab0638e7 with scrape type 2
2026-03-29 10:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79273a23-7734-5ce5-82b7-37bfab0638e7, identifier: UM48488
2026-03-29 10:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-29 10:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-29 10:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488 to the API
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:49:10Z',
'fuel_type': 'diesel',
'id': '79273a23-7734-5ce5-82b7-37bfab0638e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM48488',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 154940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-20',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC Edition',
'transmission': 'automatic',
'trim': 'lang 4Matic BlueTEC Edition',
'year': 2015}
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Saving data for UM48488: {'auction_closing_time': 1774885750.0, 'created_time': 1773466812.337144, 'last_price_update_time': 1774780690.456617}
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM48488') HTTP/1.1" 204 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for CD36674: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for EU37880: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-29 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:11 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for MT90802: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for ZV40367: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for XG94093: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for SY19126: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for CE31107: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for MM04684: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for HF47887: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for EN47046: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for ZU57618: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for PR50786: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for ZJ71499: 0
2026-03-29 10:38:11 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-29 10:38:11 [auto1.de] INFO: Scrape type for RG74932: 0
2026-03-29 10:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:13 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for BX95848: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for LX45168: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for UU73518: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for XM77164: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for HD14897: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for DZ93039: 2
2026-03-29 10:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-29 10:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76f8261-06ba-568c-81f1-805c9644ba47 with scrape type 2
2026-03-29 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e76f8261-06ba-568c-81f1-805c9644ba47 with scrape type 2
2026-03-29 10:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e76f8261-06ba-568c-81f1-805c9644ba47, identifier: DZ93039
2026-03-29 10:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-29 10:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-29 10:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039 to the API
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:25:31Z',
'fuel_type': 'petrol',
'id': 'e76f8261-06ba-568c-81f1-805c9644ba47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ93039',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 106535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-12',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2017}
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Saving data for DZ93039: {'auction_closing_time': 1774884331.0, 'created_time': 1773427172.994331, 'last_price_update_time': 1774780693.88114}
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ93039') HTTP/1.1" 204 0
2026-03-29 10:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for XT91085: 2
2026-03-29 10:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-29 10:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7138564-95f6-5414-b8e4-0075656b9eb8 with scrape type 2
2026-03-29 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7138564-95f6-5414-b8e4-0075656b9eb8 with scrape type 2
2026-03-29 10:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7138564-95f6-5414-b8e4-0075656b9eb8, identifier: XT91085
2026-03-29 10:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-29 10:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-29 10:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085 to the API
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:28:01Z',
'fuel_type': 'petrol',
'id': 'e7138564-95f6-5414-b8e4-0075656b9eb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT91085',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 175770,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-29',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2009}
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Saving data for XT91085: {'auction_closing_time': 1774884481.0, 'created_time': 1774465294.798232, 'last_price_update_time': 1774780694.475481}
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT91085') HTTP/1.1" 204 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for AG38936: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for CJ15757: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for ZX08266: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for XF58855: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-29 10:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:15 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for PN31203: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for YW88691: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for GL29302: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for BF85943: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for YH44518: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for LM46602: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for HA16942: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for EE67524: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for VY57936: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for AJ85569: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for CW59742: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for BW06132: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for TV11727: 0
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for FP32439: 2
2026-03-29 10:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-29 10:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item debf0902-9082-59c4-a4e9-e2a3aeb5e69c with scrape type 2
2026-03-29 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item debf0902-9082-59c4-a4e9-e2a3aeb5e69c with scrape type 2
2026-03-29 10:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: debf0902-9082-59c4-a4e9-e2a3aeb5e69c, identifier: FP32439
2026-03-29 10:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-29 10:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-29 10:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439 to the API
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:01:05Z',
'fuel_type': 'petrol',
'id': 'debf0902-9082-59c4-a4e9-e2a3aeb5e69c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP32439',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 157910,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-10',
'seller_name': None,
'title': 'Audi A6 2.8 V6 FSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Saving data for FP32439: {'auction_closing_time': 1774882865.0, 'created_time': 1773946201.413967, 'last_price_update_time': 1774780696.511084}
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP32439') HTTP/1.1" 204 0
2026-03-29 10:38:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for KY67779: 0
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for WJ94391: 0
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for GR86063: 0
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for UH78050: 0
2026-03-29 10:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:17 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for JL85877: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for DR31322: 2
2026-03-29 10:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-29 10:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9511f1-ad34-57b8-9122-15f87e2aa853 with scrape type 2
2026-03-29 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d9511f1-ad34-57b8-9122-15f87e2aa853 with scrape type 2
2026-03-29 10:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d9511f1-ad34-57b8-9122-15f87e2aa853, identifier: DR31322
2026-03-29 10:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-29 10:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-29 10:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322 to the API
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:16:48Z',
'fuel_type': 'diesel',
'id': '0d9511f1-ad34-57b8-9122-15f87e2aa853',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR31322',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 130690,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-03',
'seller_name': None,
'title': 'Jaguar XF 30d Portfolio',
'transmission': 'automatic',
'trim': 'Portfolio',
'year': 2017}
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Saving data for DR31322: {'auction_closing_time': 1774883808.0, 'created_time': 1773223753.060816, 'last_price_update_time': 1774780698.207536}
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR31322') HTTP/1.1" 204 0
2026-03-29 10:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for TJ09014: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for TA25367: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for AL26903: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for HL58412: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for SR77795: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for PN78353: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for SM91292: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for FZ71323: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for AH37368: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for EF84485: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-29 10:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:19 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for EG77695: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for BA73417: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for DW23670: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for WA19353: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for UY13477: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for GM59511: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for ZL15649: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for BL86865: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for SR51449: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for EN73396: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for CB52035: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for XD56030: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for CC89680: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-29 10:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:20 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for YF42870: 0
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for DG24182: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for CV73879: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for WL17910: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for BS26605: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for JS09258: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for GD60404: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for TJ67594: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for VT43931: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-29 10:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:22 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-29 10:38:22 [auto1.de] INFO: Scrape type for GV28684: 2
2026-03-29 10:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-29 10:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08482148-24a4-5327-8081-6c8b545dbe33 with scrape type 2
2026-03-29 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08482148-24a4-5327-8081-6c8b545dbe33 with scrape type 2
2026-03-29 10:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08482148-24a4-5327-8081-6c8b545dbe33, identifier: GV28684
2026-03-29 10:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-29 10:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-29 10:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684 to the API
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:28:10Z',
'fuel_type': 'petrol',
'id': '08482148-24a4-5327-8081-6c8b545dbe33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV28684',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 28854,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-30',
'seller_name': None,
'title': 'Hyundai i30 1.0 T-GDI Mild-Hybrid Select',
'transmission': 'automatic',
'trim': 'Select',
'year': 2021}
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-29 10:38:22 [auto1.de] INFO: Saving data for GV28684: {'auction_closing_time': 1774884490.0, 'created_time': 1773303239.766047, 'last_price_update_time': 1774780702.865587}
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV28684') HTTP/1.1" 204 0
2026-03-29 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-29 10:38:22 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for YS13064: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for VJ59637: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for VL16221: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for AH95980: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for PC60688: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for XM62598: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-29 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:24 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for MG28857: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for LR06917: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for UE57150: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for JX01740: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for BD98070: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for PH00076: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for AD50420: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-29 10:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:25 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for LN93862: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for BR76788: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for ZL76152: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for PA85998: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for SE32009: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for VT76935: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for AP07103: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for BE16908: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for JH64089: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for GY26864: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for MX47183: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for ZM37202: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for CS78773: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for NY15812: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for UW48203: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for EB92999: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-29 10:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:26 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for EY23363: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for HV21869: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for WK06356: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for LU56386: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for DU69800: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for AH07700: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for AF84640: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for WY87564: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for BW18754: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for GZ21000: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for GP94559: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for YM28187: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-29 10:38:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:31 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for ZE75344: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for GA26329: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for FW15462: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for AH97983: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for NP64585: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for EG01443: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for VT05460: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for BF09730: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-29 10:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:32 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for BV47016: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for ZY22077: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for YC50370: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for MZ26894: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for XF59932: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for BS14183: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for BT69693: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for ZJ17739: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for TF11415: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-29 10:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:34 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for DE35783: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for UX71045: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for WS30363: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for NS47503: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for HB69443: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for HU97464: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for SC05662: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for LF03511: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for RC37998: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-29 10:38:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:35 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-29 10:38:35 [auto1.de] INFO: Scrape type for BV72825: 2
2026-03-29 10:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-29 10:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with scrape type 2
2026-03-29 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with scrape type 2
2026-03-29 10:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3, identifier: BV72825
2026-03-29 10:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-29 10:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-29 10:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825 to the API
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:21:07Z',
'fuel_type': 'petrol',
'id': 'd2184530-3e2f-58a2-b1d5-b0d8dc8452e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV72825',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 162325,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-16',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 CGI T BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Elegance',
'year': 2010}
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Saving data for BV72825: {'auction_closing_time': 1774884067.0, 'created_time': 1774348997.25977, 'last_price_update_time': 1774780716.606076}
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV72825') HTTP/1.1" 204 0
2026-03-29 10:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for RX78682: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for UP35116: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for SV37503: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for SV69696: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for BA36034: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for BX38798: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for DJ74321: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for PK18306: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for PK39186: 0
2026-03-29 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:38 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for RG82987: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for WH66881: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for ND02727: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for WJ18132: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for JR30174: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for YJ23133: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for SX51992: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for KT07926: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for MC50567: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for NY75190: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for SS68419: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for FP97739: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for KX42000: 0
2026-03-29 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:39 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for YH85992: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for KY48204: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for NR01003: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for TJ52471: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for LB47051: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for BB05749: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for AU38078: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for BV96040: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for FK93583: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for MF11383: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for CA11296: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for HT64251: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-29 10:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:40 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for XE57640: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for HX44464: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for WD55568: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for XA59954: 2
2026-03-29 10:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-29 10:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96fbded-52a2-5b96-91fc-d7b6b502471b with scrape type 2
2026-03-29 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96fbded-52a2-5b96-91fc-d7b6b502471b with scrape type 2
2026-03-29 10:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e96fbded-52a2-5b96-91fc-d7b6b502471b, identifier: XA59954
2026-03-29 10:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-29 10:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-29 10:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954 to the API
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:47:37Z',
'fuel_type': 'petrol',
'id': 'e96fbded-52a2-5b96-91fc-d7b6b502471b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA59954',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 201006,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-17',
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Saving data for XA59954: {'auction_closing_time': 1774885657.0, 'created_time': 1774001889.108418, 'last_price_update_time': 1774780722.679243}
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA59954') HTTP/1.1" 204 0
2026-03-29 10:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for GN84809: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: US02416
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for SP71400: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for TB03124: 0
2026-03-29 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:44 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:44 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-29 10:38:44 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-29 10:38:44 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-29 10:38:44 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-29 10:38:44 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-29 10:38:44 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-29 10:38:44 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-29 10:38:44 [auto1.de] INFO: Scrape type for ZN04335: 0
2026-03-29 10:38:44 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-29 10:38:44 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-29 10:38:44 [auto1.de] INFO: Scrape type for SR63884: 0
2026-03-29 10:38:44 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-29 10:38:44 [auto1.de] INFO: Scrape type for MR29539: 2
2026-03-29 10:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with identifier: MR29539
2026-03-29 10:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with scrape type 2
2026-03-29 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with scrape type 2
2026-03-29 10:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1377e7dc-1ca2-58df-a43f-a6f7991534d6, identifier: MR29539
2026-03-29 10:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with identifier: MR29539
2026-03-29 10:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with identifier: MR29539
2026-03-29 10:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with identifier: MR29539 to the API
2026-03-29 10:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:12Z',
'fuel_type': 'diesel',
'id': '1377e7dc-1ca2-58df-a43f-a6f7991534d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR29539',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 135606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-25',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2018}
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Saving data for MR29539: {'auction_closing_time': 1774885572.0, 'created_time': 1774596644.78858, 'last_price_update_time': 1774780725.365448}
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR29539') HTTP/1.1" 204 0
2026-03-29 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for ZA74558: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for UL19330: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for DH60406: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for LV98525: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for FF90181: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for PS26933: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for KK20650: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for AJ08508: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for JW09174: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for XL45586: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for JF78286: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for NS04983: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for MM23773: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for FY22177: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for ZS84546: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-29 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:47 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for BD72910: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for NG76002: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for AJ71122: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for MV27472: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for GB27977: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for DM13382: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for XR73410: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for BG13835: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for KX79678: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for BJ03907: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for BE52525: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for ZD84444: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for AS79616: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for FD07804: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for MK09620: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for TP67168: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for AL71232: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-29 10:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:48 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for YH93335: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for HA99169: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for GU28360: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for NY39865: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for BH40486: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for FC58368: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for EU55937: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for TL72428: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for CT75216: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for CN22561: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for ZH54779: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-29 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:50 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for KV75239: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for WN20430: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for UE30876: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for EY98011: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for MK93259: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for NY21344: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for NS09930: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for HL07149: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for XR43208: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for KU93910: 0
2026-03-29 10:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:51 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for EC39473: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for ND18169: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for EE74949: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for AN93893: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for AP20693: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for VX05177: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for JL91815: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: US61717
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-29 10:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:52 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-29 10:38:52 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for XP10598: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for FM49388: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for HT48359: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for RZ86023: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-29 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:54 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for LH51780: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for UX47002: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for XP96351: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for TM66386: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for MV92547: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for WL10604: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for YP37345: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for PX47030: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for KW72669: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for SZ10404: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for MP44977: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for AR33954: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for CE68759: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for LJ68235: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for AW26108: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for EC74122: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for EJ12041: 0
2026-03-29 10:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:56 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for WM50806: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for WV19329: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for VR66334: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for WW55400: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for AX24898: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for GD44773: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for FA59135: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for YE81869: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for JG82377: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for GJ77265: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-29 10:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:06 [scrapy.extensions.logstats] INFO: Crawled 183 pages (at 26 pages/min), scraped 264 items (at 10 items/min)
2026-03-29 10:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:27 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-29 10:39:27 [auto1.de] INFO: Scrape type for BY18365: 0
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-29 10:39:27 [auto1.de] INFO: Scrape type for FX80624: 0
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-29 10:39:27 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-29 10:39:27 [auto1.de] INFO: Scrape type for GX75432: 0
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-29 10:39:27 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-29 10:39:27 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for GM45973: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for EJ52813: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for BX52940: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for SX52884: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for RV05301: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for BL02906: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for WW79477: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for MU06358: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for GE87881: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for ZY60733: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for GH74073: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-29 10:39:28 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-29 10:39:28 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-29 10:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:31 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for VW88901: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for DK10933: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for ZY38898: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for UW42720: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for CA65369: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: US56502
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for SD28198: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for MX86281: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for HW30650: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for GJ36407: 0
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-29 10:39:31 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-29 10:39:31 [auto1.de] INFO: Scrape type for ME64315: 2
2026-03-29 10:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-29 10:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7697bc61-fa0a-540d-a685-a5e42a561ae9 with scrape type 2
2026-03-29 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7697bc61-fa0a-540d-a685-a5e42a561ae9 with scrape type 2
2026-03-29 10:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7697bc61-fa0a-540d-a685-a5e42a561ae9, identifier: ME64315
2026-03-29 10:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-29 10:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-29 10:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315 to the API
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:37Z',
'fuel_type': 'diesel',
'id': '7697bc61-fa0a-540d-a685-a5e42a561ae9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME64315',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 266282,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-02',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Cup BlueMotion',
'transmission': 'manual',
'trim': 'Cup BlueMotion',
'year': 2014}
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-29 10:39:32 [auto1.de] INFO: Saving data for ME64315: {'auction_closing_time': 1774883917.0, 'created_time': 1773307791.268957, 'last_price_update_time': 1774780772.122236}
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME64315') HTTP/1.1" 204 0
2026-03-29 10:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-29 10:39:32 [auto1.de] INFO: Scrape type for WX41369: 0
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-29 10:39:32 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-29 10:39:32 [auto1.de] INFO: Scrape type for DK89074: 0
2026-03-29 10:39:32 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-29 10:39:32 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-29 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:33 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for MN48285: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for FF62684: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for PP24406: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for MZ72093: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for TB77095: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for YB40017: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for HL71363: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for FZ89308: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: US92808
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for US92808: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for SG17640: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for WW27642: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-29 10:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:34 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for JG45711: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for PC42452: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-29 10:39:34 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-29 10:39:34 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-29 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-29 10:39:35 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-29 10:39:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:36 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for ER69054: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for WB38942: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for XS50752: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for LR98326: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for DW90276: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for UA17642: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for YM57013: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-29 10:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:38 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for XY70185: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for LP67164: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for ZF64276: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for VH67229: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for MF45027: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for NV13181: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for NF91917: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for WS69855: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for TB49418: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for TW80485: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for JD76793: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-29 10:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:39 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for ZV64166: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for EP38579: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for ZJ64916: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for HP00850: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for TW44839: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for HX15626: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for RL20580: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for AX39550: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for CG53828: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for RF33157: 0
2026-03-29 10:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:41 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for JT67031: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for MA51695: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for VL78522: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for TH91647: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for PC91683: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for XG51341: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for BS00370: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for HD47083: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for CT53994: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for MA63217: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-29 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:44 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for DE59201: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for XK18770: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for XP95900: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for ND25281: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for SD67792: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for LE21956: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for SC73852: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for SX98211: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for YU55800: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for PV56207: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for DW00961: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for MJ13308: 0
2026-03-29 10:39:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:46 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-29 10:39:46 [auto1.de] INFO: Scrape type for BD43064: 0
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-29 10:39:46 [auto1.de] INFO: Scrape type for YB62347: 0
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-29 10:39:46 [auto1.de] INFO: Scrape type for VS70073: 2
2026-03-29 10:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-29 10:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cf8992-6ada-55eb-b88a-a95df9279cda with scrape type 2
2026-03-29 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47cf8992-6ada-55eb-b88a-a95df9279cda with scrape type 2
2026-03-29 10:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47cf8992-6ada-55eb-b88a-a95df9279cda, identifier: VS70073
2026-03-29 10:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-29 10:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-29 10:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073 to the API
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:46:04Z',
'fuel_type': 'diesel',
'id': '47cf8992-6ada-55eb-b88a-a95df9279cda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS70073',
'listing': 'auction',
'make': 'Toyota',
'model': 'ProAce Verso',
'odometer': 45588,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-31',
'seller_name': None,
'title': 'Toyota ProAce Verso 2.0 D-4D L2 Executive',
'transmission': 'automatic',
'trim': 'L2 Executive',
'year': 2021}
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Saving data for VS70073: {'auction_closing_time': 1774885564.0, 'created_time': 1772729327.876622, 'last_price_update_time': 1774780787.557707}
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS70073') HTTP/1.1" 204 0
2026-03-29 10:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for AW92068: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for WP04220: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for UX30716: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for ZJ20078: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for WB37074: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for JF95451: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for LK66468: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for TK27520: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for ZS04919: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for JR60766: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-29 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:49 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for YV09971: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for PW95662: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for KF40481: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for EG14085: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for XP52765: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for UM78498: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for WM97258: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for NM34350: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for YT60499: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for ZU85888: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for DK81412: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-29 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:53 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-29 10:39:53 [auto1.de] INFO: Scrape type for SK08799: 0
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-29 10:39:53 [auto1.de] INFO: Scrape type for GT57416: 0
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-29 10:39:53 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-29 10:39:53 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-29 10:39:53 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-29 10:39:53 [auto1.de] INFO: Scrape type for JR87294: 0
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-29 10:39:53 [auto1.de] INFO: Scrape type for XV15906: 0
2026-03-29 10:39:53 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-29 10:39:53 [auto1.de] INFO: Scrape type for FV46397: 2
2026-03-29 10:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-29 10:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328c70d1-6864-50cc-a61a-6c1db0f98b78 with scrape type 2
2026-03-29 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328c70d1-6864-50cc-a61a-6c1db0f98b78 with scrape type 2
2026-03-29 10:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 328c70d1-6864-50cc-a61a-6c1db0f98b78, identifier: FV46397
2026-03-29 10:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-29 10:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-29 10:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397 to the API
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:39:41Z',
'fuel_type': 'petrol',
'id': '328c70d1-6864-50cc-a61a-6c1db0f98b78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV46397',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 99311,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-30',
'seller_name': None,
'title': 'Suzuki SX4 1.6 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2012}
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Saving data for FV46397: {'auction_closing_time': 1774885181.0, 'created_time': 1773137679.091028, 'last_price_update_time': 1774780794.531201}
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV46397') HTTP/1.1" 204 0
2026-03-29 10:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for RB77182: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for HA44433: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for CC89371: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for BX01003: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for LK17231: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for PB00515: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for EX67189: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for LL09257: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for SC92751: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for KS94316: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for ML83071: 0
2026-03-29 10:39:54 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-29 10:39:54 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-29 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:59 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for YL63918: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for XR15758: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: US86443
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for HV40211: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for ZG52180: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for JY24308: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for RJ15430: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for VJ26450: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for UD91634: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for DN11419: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for WC38783: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for UL11229: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for NA89904: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for HF93741: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for KB62018: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for UC48235: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for GV24790: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for UE28952: 0
2026-03-29 10:39:59 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-29 10:39:59 [auto1.de] INFO: Scrape type for JN13946: 0
2026-03-29 10:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:06 [scrapy.extensions.logstats] INFO: Crawled 196 pages (at 13 pages/min), scraped 267 items (at 3 items/min)
2026-03-29 10:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:11 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for AE12757: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for GA58010: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for PZ27483: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for DJ97721: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for XD68871: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for VE41412: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for FH31570: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for SV69616: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for VB56822: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for EB81332: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for HM11779: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for CU93791: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-29 10:40:11 [auto1.de] INFO: Scrape type for SG31546: 0
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-29 10:40:11 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-29 10:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:12 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for NZ68458: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for CU11315: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for CD13649: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for BP82527: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for FX32627: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for XM89515: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for BX10295: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for YM11561: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for RR41525: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for XB63753: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-29 10:40:12 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-29 10:40:12 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-29 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-29 10:40:13 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-29 10:40:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:13 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:13 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-29 10:40:13 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-29 10:40:13 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-29 10:40:13 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-29 10:40:13 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-29 10:40:13 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for ZE10872: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for TN09859: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-29 10:40:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:15 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for FZ40219: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for JS15071: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for SN98432: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for XT08525: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for GL59385: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for FL14438: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for AP13896: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for HX75388: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for LU16486: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for TV60687: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-29 10:40:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:35 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for CA50565: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for GE73392: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for LX68947: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for ZW26780: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for VX06464: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for KA69017: 0
2026-03-29 10:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:43 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-29 10:40:43 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-29 10:40:43 [auto1.de] INFO: Scrape type for KR60146: 0
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-29 10:40:43 [auto1.de] INFO: Scrape type for JH22526: 0
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-29 10:40:43 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-29 10:40:43 [auto1.de] INFO: Scrape type for AT56964: 0
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-29 10:40:43 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-29 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for LG62730: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for XS50717: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for TK47054: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for LM30127: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for PE74408: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for RW09760: 2
2026-03-29 10:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-29 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84e8fa5-03a4-5a74-9875-2ecdf36d688c with scrape type 2
2026-03-29 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b84e8fa5-03a4-5a74-9875-2ecdf36d688c with scrape type 2
2026-03-29 10:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b84e8fa5-03a4-5a74-9875-2ecdf36d688c, identifier: RW09760
2026-03-29 10:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-29 10:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-29 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760 to the API
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 114,
'expiration_date': '2026-03-30T15:57:51Z',
'fuel_type': 'petrol',
'id': 'b84e8fa5-03a4-5a74-9875-2ecdf36d688c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW09760',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 46229,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-08',
'seller_name': None,
'title': 'Volkswagen Caddy 1.5 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Saving data for RW09760: {'auction_closing_time': 1774886271.0, 'created_time': 1774510235.452364, 'last_price_update_time': 1774780844.748599}
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW09760') HTTP/1.1" 204 0
2026-03-29 10:40:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for VX15000: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for CC75051: 0
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-29 10:40:44 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-29 10:40:44 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-29 10:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:55 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for EH74831: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for BN99160: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for ZK28238: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for NM28513: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for YM60509: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for HA69467: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for EA13561: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for XK59182: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for SG91001: 2
2026-03-29 10:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-29 10:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4982cc3c-2250-5b45-942a-009b56c67ceb with scrape type 2
2026-03-29 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4982cc3c-2250-5b45-942a-009b56c67ceb with scrape type 2
2026-03-29 10:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4982cc3c-2250-5b45-942a-009b56c67ceb, identifier: SG91001
2026-03-29 10:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-29 10:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-29 10:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001 to the API
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:29:10Z',
'fuel_type': 'petrol',
'id': '4982cc3c-2250-5b45-942a-009b56c67ceb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG91001',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 173645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-18',
'seller_name': None,
'title': 'Renault Megane 1.4 TCe BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2013}
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Saving data for SG91001: {'auction_closing_time': 1774884550.0, 'created_time': 1774348903.964932, 'last_price_update_time': 1774780856.649944}
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG91001') HTTP/1.1" 204 0
2026-03-29 10:40:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for DX61886: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for MR38870: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for ZN01973: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for YS21206: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-29 10:40:56 [auto1.de] INFO: Scrape type for LD79531: 0
2026-03-29 10:40:56 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-29 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:00 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for LD63966: 2
2026-03-29 10:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-29 10:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb8396d4-9655-572c-8e63-09596ed21c7d with scrape type 2
2026-03-29 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb8396d4-9655-572c-8e63-09596ed21c7d with scrape type 2
2026-03-29 10:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb8396d4-9655-572c-8e63-09596ed21c7d, identifier: LD63966
2026-03-29 10:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-29 10:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-29 10:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966 to the API
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:10:25Z',
'fuel_type': 'petrol',
'id': 'cb8396d4-9655-572c-8e63-09596ed21c7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD63966',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 68954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-19',
'seller_name': None,
'title': 'Ford Fiesta 1.1 Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2018}
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Saving data for LD63966: {'auction_closing_time': 1774883425.0, 'created_time': 1774596636.321414, 'last_price_update_time': 1774780860.577353}
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD63966') HTTP/1.1" 204 0
2026-03-29 10:41:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for PT52067: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for MH24339: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for TV17454: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for AB49272: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for NG37948: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-29 10:41:06 [scrapy.extensions.logstats] INFO: Crawled 204 pages (at 8 pages/min), scraped 270 items (at 3 items/min)
2026-03-29 10:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:08 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:08 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-29 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-29 10:41:08 [auto1.de] INFO: Scrape type for WP81367: 0
2026-03-29 10:41:08 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-29 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-29 10:41:08 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-29 10:41:08 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-29 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-29 10:41:08 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-29 10:41:08 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for RC84625: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for VF40931: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for PB99961: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for HD35365: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for GC05156: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for HS66521: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for YT67181: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for GM00936: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for RW93776: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for EK21596: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for TL42173: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-29 10:41:09 [auto1.de] INFO: Scrape type for EC36203: 0
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-29 10:41:09 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-29 10:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:11 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:11 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-29 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-29 10:41:11 [auto1.de] INFO: Scrape type for PU13127: 2
2026-03-29 10:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-29 10:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 486f9803-6151-5685-92af-9b5451c918dd with scrape type 2
2026-03-29 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 486f9803-6151-5685-92af-9b5451c918dd with scrape type 2
2026-03-29 10:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 486f9803-6151-5685-92af-9b5451c918dd, identifier: PU13127
2026-03-29 10:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-29 10:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-29 10:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127 to the API
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:02:11Z',
'fuel_type': 'diesel',
'id': '486f9803-6151-5685-92af-9b5451c918dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU13127',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 220872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-11',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2015}
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Saving data for PU13127: {'auction_closing_time': 1774882931.0, 'created_time': 1774349526.69582, 'last_price_update_time': 1774780872.413874}
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU13127') HTTP/1.1" 204 0
2026-03-29 10:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for DF28851: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for HL77146: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for XR58128: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for ST45837: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for JU26227: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for MU44330: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for GV67460: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-29 10:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:13 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for NH48980: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for UZ14919: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for KC56991: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for SP37211: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for ZJ20785: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for HJ15324: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for NL79635: 0
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-29 10:41:13 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for DP76469: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for LU20114: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for MA38279: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for PZ30496: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for CH12661: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for HC35889: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for ZM69821: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for KF80964: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for KR40526: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for NS83554: 0
2026-03-29 10:41:14 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-29 10:41:14 [auto1.de] INFO: Scrape type for UV09635: 0
2026-03-29 10:41:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:15 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for LR83897: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for EX09851: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for RT47788: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for NF65308: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for RB21288: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for TL00985: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for SM64754: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for PL66942: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for RU39212: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for ZS99681: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for EE75447: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for RP15985: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for SP96955: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for GS31332: 0
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-29 10:41:15 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-29 10:41:15 [auto1.de] INFO: Scrape type for TH39634: 0
2026-03-29 10:41:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:16 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for MY94359: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for ZS85048: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for ZY92659: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for DK37949: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for RF12873: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for XR35811: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for NC71734: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for JN07474: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for XZ21442: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for YE73742: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for CA87699: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for XU33519: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for NK26673: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for NM76791: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: AU44008
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU44008%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for AU44008: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for UN89180: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for YH18669: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for KD63113: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for FL46038: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for NX82618: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for ZD28041: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for LK56613: 0
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-29 10:41:16 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-29 10:41:16 [auto1.de] INFO: Scrape type for KV17598: 0
2026-03-29 10:41:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:06 [scrapy.extensions.logstats] INFO: Crawled 209 pages (at 5 pages/min), scraped 271 items (at 1 items/min)
2026-03-29 10:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:22 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-29 10:42:22 [auto1.de] INFO: Scrape type for HX78633: 0
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-29 10:42:22 [auto1.de] INFO: Scrape type for GY83312: 0
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-29 10:42:22 [auto1.de] INFO: Scrape type for BG42804: 0
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-29 10:42:22 [auto1.de] INFO: Scrape type for HG43188: 0
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-29 10:42:22 [auto1.de] INFO: Scrape type for CW85183: 0
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-29 10:42:22 [auto1.de] INFO: Scrape type for KV68719: 0
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: JP17422
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP17422%27 HTTP/1.1" 200 None
2026-03-29 10:42:22 [auto1.de] INFO: Scrape type for JP17422: 0
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-29 10:42:22 [auto1.de] INFO: Scrape type for GJ18953: 0
2026-03-29 10:42:22 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for GR83992: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for BV89454: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for MX21840: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for DR45963: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for RW68722: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for JX30830: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for EC85375: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for VX97978: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for ED69500: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for AN99140: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for FD40697: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for UK28270: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for UG29438: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for NY30954: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for NZ79152: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for HH84481: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-29 10:42:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:24 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for KA54911: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for TV53465: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for UP69379: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for TP61394: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for BU21003: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for CG91765: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for NG66001: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for EA38947: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for HZ69536: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for TK93923: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for CS73315: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for SE41978: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for NS35557: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for LW95470: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for GY54695: 0
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Scrape type for TV85934: 0
2026-03-29 10:42:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:26 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:26 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-29 10:42:26 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-29 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-29 10:42:26 [auto1.de] INFO: Scrape type for YN15081: 0
2026-03-29 10:42:26 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-29 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-29 10:42:26 [auto1.de] INFO: Scrape type for PR24120: 0
2026-03-29 10:42:26 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-29 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-29 10:42:26 [auto1.de] INFO: Scrape type for WB47522: 0
2026-03-29 10:42:26 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-29 10:42:26 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for JL46304: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for LL96634: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for HV52023: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for YT21216: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for EH91304: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for RR27166: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for SJ72548: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for SY42721: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for RM21545: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for UC78524: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for WG52031: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for RY75144: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for BX11542: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for DN27813: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for HZ35402: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for WA51516: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for GA49917: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for CC10989: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for MP53713: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for YA63127: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for WK48382: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for AN23805: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for VL97674: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for UT78656: 0
2026-03-29 10:42:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:35 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for RT81127: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for KK21790: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for TV45930: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for DZ20117: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for BR60141: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for YA36470: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for VR29597: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for LT01381: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for ZX19467: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for BC54503: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for YR75150: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for TP97389: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for EC10607: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for LE99206: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for PH13735: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for CY46145: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for NC58057: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for TF03370: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for FF37262: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for UL28707: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for FR17679: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for XG50299: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for VR85555: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-29 10:42:35 [auto1.de] INFO: Scrape type for VB32886: 0
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-29 10:42:35 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-29 10:42:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:36 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:36 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for DC55349: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for HM04559: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for CE21106: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for BN42758: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for ZH67756: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for PN96283: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for KZ38664: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for MF03624: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for EK32140: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: GE75594
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE75594%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for GE75594: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for BH61935: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for CV13370: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for GF54025: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for KK05104: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for DT00553: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for GM93554: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for KC33777: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for JD18961: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for EU91257: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-29 10:42:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:41 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: XK86012
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK86012%27 HTTP/1.1" 200 None
2026-03-29 10:42:41 [auto1.de] INFO: Scrape type for XK86012: 0
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-29 10:42:41 [auto1.de] INFO: Scrape type for MJ24427: 0
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-29 10:42:41 [auto1.de] INFO: Scrape type for TY73105: 0
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-29 10:42:41 [auto1.de] INFO: Scrape type for ZC07667: 0
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-29 10:42:41 [auto1.de] INFO: Scrape type for RY65257: 0
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-29 10:42:41 [auto1.de] INFO: Scrape type for AN00284: 0
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for PW75443: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for XZ09557: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for ZU51849: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for VS08295: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for DZ10370: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for LH85097: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM06899%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for ZM06899: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for MW28967: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for ZB32219: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for HL71303: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for HP58071: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for DZ90314: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for ZD05213: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for WC53392: 0
2026-03-29 10:42:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:51 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for JZ33625: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for SS01468: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for VU61436: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for YD79813: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for JR23306: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for YN71631: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for EM86154: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for SK06184: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for SZ07968: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for RT44513: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for JB74543: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for HX73394: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for ES38254: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for PU69799: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for BM68891: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for AN35443: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for CP64572: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for CA31284: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for JE64211: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for RU51924: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for UM98970: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for PP81333: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-29 10:42:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:53 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for RS29828: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for WB65429: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for BV82977: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for ZV11386: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for FW24707: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for NE29415: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for LF31183: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for RU06209: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for CN30644: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for PC42361: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for ZD03679: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for AJ68338: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for XY91311: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for UJ32060: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for VX51529: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for ZX35580: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for MB10012: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for JB16135: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for WX88880: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for AL99999: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for LD20816: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for FR59515: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for PB68045: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-29 10:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:56 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for FK87134: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for AC64408: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for MS92853: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for KJ96076: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: US66744
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for US66744: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for GB90564: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for RL85498: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for NV50024: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for WB83413: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for NX27502: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for MF21991: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for XR92513: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for GZ82101: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for FT59815: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for TN55271: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for ZA78506: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for XT20747: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for GF23268: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for YD01023: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-29 10:42:56 [auto1.de] INFO: Scrape type for GJ73585: 0
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-29 10:42:56 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-29 10:42:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:01 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for YC95910: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for HE47734: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for JR52179: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for LD23223: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for LM31898: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for HL01555: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for WJ67055: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for EJ09183: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for GZ17275: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for GY04691: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: JD07645
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for WD20973: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for RN07993: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for EC99072: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for EN09392: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for DT06996: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for DK35136: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for WJ60429: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for RX22328: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for FG48361: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for VE13678: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for WM91088: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for CG06120: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for XX47236: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for AY24824: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-29 10:43:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:02 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for JR48888: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for WX17645: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for FP27721: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for KC60426: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for EL78604: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for KP52427: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for UZ60031: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for YP26052: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for UX04638: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for XT42092: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for ER27214: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for DU68074: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for ZN38550: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for TR40985: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for BW25069: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for UH14714: 0
2026-03-29 10:43:02 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-29 10:43:02 [auto1.de] INFO: Scrape type for WR70011: 0
2026-03-29 10:43:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:03 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for UP55636: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for ZT83144: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for UY91981: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for VR01975: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for HL66974: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for CJ73141: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for LT88740: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for FE36611: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for ST78057: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for PV80087: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for KY32435: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for PY07739: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for DN86096: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for RV77607: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for UP26126: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for TV59519: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for AC34212: 0
2026-03-29 10:43:04 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-29 10:43:04 [auto1.de] INFO: Scrape type for EW67018: 0
2026-03-29 10:43:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:06 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for AL30364: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for FW19107: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for SJ02125: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for VL24807: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for NF97550: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for ZA82087: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for PR51827: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for KU26816: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for CM42106: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for UR14680: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for GZ33681: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for XT67395: 0
2026-03-29 10:43:06 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-29 10:43:06 [auto1.de] INFO: Scrape type for XT85364: 0
2026-03-29 10:43:06 [scrapy.extensions.logstats] INFO: Crawled 222 pages (at 13 pages/min), scraped 271 items (at 0 items/min)
2026-03-29 10:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:11 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for KJ39198: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for EX55373: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for BN44220: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for KT60539: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for JM65569: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for LX23482: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for KC29293: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for HM10485: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for GZ74020: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for HZ02763: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for KZ16493: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for DF05561: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for GK39429: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for MV07839: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for AW19440: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for DG41556: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for HU15676: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for SV56483: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for ZM61762: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for LJ25581: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for LL75700: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-29 10:43:11 [auto1.de] INFO: Scrape type for NG57043: 0
2026-03-29 10:43:11 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-29 10:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:12 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for XA48872: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for ZZ30319: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for FJ78997: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for SC04632: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for CA87929: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for GL40281: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for WC65602: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for HF13996: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for RX58241: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for VN03026: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for NS77188: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for GT32005: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for SF89930: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for FF09080: 0
2026-03-29 10:43:12 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-29 10:43:12 [auto1.de] INFO: Scrape type for XU36975: 2
2026-03-29 10:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-29 10:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07c6e13-b877-5e52-9d28-864d800235c3 with scrape type 2
2026-03-29 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07c6e13-b877-5e52-9d28-864d800235c3 with scrape type 2
2026-03-29 10:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c07c6e13-b877-5e52-9d28-864d800235c3, identifier: XU36975
2026-03-29 10:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-29 10:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975
2026-03-29 10:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c07c6e13-b877-5e52-9d28-864d800235c3 with identifier: XU36975 to the API
2026-03-29 10:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:09:11Z',
'fuel_type': 'diesel',
'id': 'c07c6e13-b877-5e52-9d28-864d800235c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU36975',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 150814,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-31',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-29 10:43:13 [auto1.de] INFO: Saving data for XU36975: {'auction_closing_time': 1774883351.0, 'created_time': 1774032302.779476, 'last_price_update_time': 1774780993.200565}
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU36975') HTTP/1.1" 204 0
2026-03-29 10:43:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:13 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-29 10:43:13 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-29 10:43:13 [auto1.de] INFO: Scrape type for NF23902: 2
2026-03-29 10:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-29 10:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169ad459-f862-5e89-b5db-ec445315b82c with scrape type 2
2026-03-29 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 169ad459-f862-5e89-b5db-ec445315b82c with scrape type 2
2026-03-29 10:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 169ad459-f862-5e89-b5db-ec445315b82c, identifier: NF23902
2026-03-29 10:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-29 10:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902
2026-03-29 10:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 169ad459-f862-5e89-b5db-ec445315b82c with identifier: NF23902 to the API
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:03:12Z',
'fuel_type': 'petrol',
'id': '169ad459-f862-5e89-b5db-ec445315b82c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF23902',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 109457,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-09-21',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'automatic',
'trim': '',
'year': 2004}
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-29 10:43:13 [auto1.de] INFO: Saving data for NF23902: {'auction_closing_time': 1774882992.0, 'created_time': 1774694070.677332, 'last_price_update_time': 1774780993.786579}
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF23902') HTTP/1.1" 204 0
2026-03-29 10:43:13 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-29 10:43:13 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-29 10:43:13 [auto1.de] INFO: Scrape type for TR04886: 2
2026-03-29 10:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-29 10:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609b1033-9c44-5f99-9bac-fda2e590b8cc with scrape type 2
2026-03-29 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609b1033-9c44-5f99-9bac-fda2e590b8cc with scrape type 2
2026-03-29 10:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 609b1033-9c44-5f99-9bac-fda2e590b8cc, identifier: TR04886
2026-03-29 10:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-29 10:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886
2026-03-29 10:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 609b1033-9c44-5f99-9bac-fda2e590b8cc with identifier: TR04886 to the API
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:47:17Z',
'fuel_type': 'diesel',
'id': '609b1033-9c44-5f99-9bac-fda2e590b8cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR04886',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 206563,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-12',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2015}
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-29 10:43:14 [auto1.de] INFO: Saving data for TR04886: {'auction_closing_time': 1774885637.0, 'created_time': 1773427570.077662, 'last_price_update_time': 1774780994.190514}
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR04886') HTTP/1.1" 204 0
2026-03-29 10:43:14 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-29 10:43:14 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-29 10:43:14 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-29 10:43:14 [auto1.de] INFO: Scrape type for JR73784: 2
2026-03-29 10:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-29 10:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5971df60-ac54-5a7b-ad21-40a94a0553b9 with scrape type 2
2026-03-29 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5971df60-ac54-5a7b-ad21-40a94a0553b9 with scrape type 2
2026-03-29 10:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5971df60-ac54-5a7b-ad21-40a94a0553b9, identifier: JR73784
2026-03-29 10:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-29 10:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784
2026-03-29 10:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5971df60-ac54-5a7b-ad21-40a94a0553b9 with identifier: JR73784 to the API
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-30T15:28:10Z',
'fuel_type': 'diesel',
'id': '5971df60-ac54-5a7b-ad21-40a94a0553b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR73784',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 109757,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-08',
'seller_name': None,
'title': 'Volvo XC60 2.0 D5 R Design AWD',
'transmission': 'automatic',
'trim': 'R Design AWD',
'year': 2018}
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-29 10:43:14 [auto1.de] INFO: Saving data for JR73784: {'auction_closing_time': 1774884490.0, 'created_time': 1774694022.727475, 'last_price_update_time': 1774780994.587245}
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR73784') HTTP/1.1" 204 0
2026-03-29 10:43:14 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-29 10:43:14 [auto1.de] INFO: Scrape type for TK15682: 2
2026-03-29 10:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-29 10:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60903643-49cb-5ccd-9b82-f03261647587 with scrape type 2
2026-03-29 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60903643-49cb-5ccd-9b82-f03261647587 with scrape type 2
2026-03-29 10:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60903643-49cb-5ccd-9b82-f03261647587, identifier: TK15682
2026-03-29 10:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-29 10:43:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682
2026-03-29 10:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60903643-49cb-5ccd-9b82-f03261647587 with identifier: TK15682 to the API
2026-03-29 10:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:16:08Z',
'fuel_type': 'diesel',
'id': '60903643-49cb-5ccd-9b82-f03261647587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK15682',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon',
'odometer': 157532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-12',
'seller_name': None,
'title': 'Volkswagen Arteon 2.0 TDI R-Line 4Motion',
'transmission': 'automatic',
'trim': 'R-Line 4Motion',
'year': 2017}
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-29 10:43:15 [auto1.de] INFO: Saving data for TK15682: {'auction_closing_time': 1774883768.0, 'created_time': 1774118855.350655, 'last_price_update_time': 1774780995.157987}
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK15682') HTTP/1.1" 204 0
2026-03-29 10:43:15 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-29 10:43:15 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-29 10:43:15 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-29 10:43:15 [auto1.de] INFO: Scrape type for DT59270: 2
2026-03-29 10:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-29 10:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with scrape type 2
2026-03-29 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with scrape type 2
2026-03-29 10:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335, identifier: DT59270
2026-03-29 10:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-29 10:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270
2026-03-29 10:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a3e11d4-bc1d-57e5-b3d9-ff25ff247335 with identifier: DT59270 to the API
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:44:18Z',
'fuel_type': 'petrol',
'id': '1a3e11d4-bc1d-57e5-b3d9-ff25ff247335',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT59270',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 45447,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-13',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2017}
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-29 10:43:15 [auto1.de] INFO: Saving data for DT59270: {'auction_closing_time': 1774885458.0, 'created_time': 1774693928.776859, 'last_price_update_time': 1774780995.56963}
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT59270') HTTP/1.1" 204 0
2026-03-29 10:43:15 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-29 10:43:15 [auto1.de] INFO: Scrape type for SD29600: 2
2026-03-29 10:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-29 10:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590baee3-5512-5e1d-a530-48658d9f3432 with scrape type 2
2026-03-29 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 590baee3-5512-5e1d-a530-48658d9f3432 with scrape type 2
2026-03-29 10:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 590baee3-5512-5e1d-a530-48658d9f3432, identifier: SD29600
2026-03-29 10:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-29 10:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600
2026-03-29 10:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 590baee3-5512-5e1d-a530-48658d9f3432 with identifier: SD29600 to the API
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:42:48Z',
'fuel_type': 'petrol',
'id': '590baee3-5512-5e1d-a530-48658d9f3432',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD29600',
'listing': 'auction',
'make': 'Nissan',
'model': 'Almera',
'odometer': 96916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-13',
'seller_name': None,
'title': 'Nissan Almera 1.5 Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2006}
2026-03-29 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-29 10:43:16 [auto1.de] INFO: Saving data for SD29600: {'auction_closing_time': 1774885368.0, 'created_time': 1774348995.464131, 'last_price_update_time': 1774780996.096055}
2026-03-29 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD29600') HTTP/1.1" 204 0
2026-03-29 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:16 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:16 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-29 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-29 10:43:16 [auto1.de] INFO: Scrape type for AY51976: 2
2026-03-29 10:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-29 10:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with scrape type 2
2026-03-29 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with scrape type 2
2026-03-29 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a, identifier: AY51976
2026-03-29 10:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-29 10:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976
2026-03-29 10:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bfa0bbd-d13d-5301-ae16-bb3e967a884a with identifier: AY51976 to the API
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:59:07Z',
'fuel_type': 'petrol',
'id': '8bfa0bbd-d13d-5301-ae16-bb3e967a884a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY51976',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 141497,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-16',
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-29 10:43:17 [auto1.de] INFO: Saving data for AY51976: {'auction_closing_time': 1774886347.0, 'created_time': 1774694032.577939, 'last_price_update_time': 1774780997.292247}
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY51976') HTTP/1.1" 204 0
2026-03-29 10:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:17 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-29 10:43:17 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-29 10:43:17 [auto1.de] INFO: Scrape type for KT35256: 2
2026-03-29 10:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-29 10:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with scrape type 2
2026-03-29 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with scrape type 2
2026-03-29 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 048e54bd-b608-5f6e-853c-0a5ca9facfb2, identifier: KT35256
2026-03-29 10:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-29 10:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256
2026-03-29 10:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 048e54bd-b608-5f6e-853c-0a5ca9facfb2 with identifier: KT35256 to the API
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:04:54Z',
'fuel_type': 'petrol',
'id': '048e54bd-b608-5f6e-853c-0a5ca9facfb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT35256',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 55346,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-23',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2012}
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-29 10:43:17 [auto1.de] INFO: Saving data for KT35256: {'auction_closing_time': 1774883094.0, 'created_time': 1773400451.799684, 'last_price_update_time': 1774780997.695483}
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT35256') HTTP/1.1" 204 0
2026-03-29 10:43:17 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-29 10:43:17 [auto1.de] INFO: Scrape type for ZY39038: 2
2026-03-29 10:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-29 10:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8865f45d-a5c2-53d1-8c08-6e10660285cd with scrape type 2
2026-03-29 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8865f45d-a5c2-53d1-8c08-6e10660285cd with scrape type 2
2026-03-29 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8865f45d-a5c2-53d1-8c08-6e10660285cd, identifier: ZY39038
2026-03-29 10:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-29 10:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038
2026-03-29 10:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8865f45d-a5c2-53d1-8c08-6e10660285cd with identifier: ZY39038 to the API
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:40:13Z',
'fuel_type': 'petrol',
'id': '8865f45d-a5c2-53d1-8c08-6e10660285cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY39038',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 109135,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-03',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Edition ecoFlex',
'transmission': 'manual',
'trim': 'Edition ecoFlex',
'year': 2015}
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-29 10:43:18 [auto1.de] INFO: Saving data for ZY39038: {'auction_closing_time': 1774885213.0, 'created_time': 1774694074.681259, 'last_price_update_time': 1774780998.111006}
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY39038') HTTP/1.1" 204 0
2026-03-29 10:43:18 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-29 10:43:18 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-29 10:43:18 [auto1.de] INFO: Scrape type for EA52308: 2
2026-03-29 10:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-29 10:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e849fe6-7241-5809-921f-b47784246f31 with scrape type 2
2026-03-29 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e849fe6-7241-5809-921f-b47784246f31 with scrape type 2
2026-03-29 10:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e849fe6-7241-5809-921f-b47784246f31, identifier: EA52308
2026-03-29 10:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-29 10:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308
2026-03-29 10:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e849fe6-7241-5809-921f-b47784246f31 with identifier: EA52308 to the API
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:42Z',
'fuel_type': 'diesel',
'id': '8e849fe6-7241-5809-921f-b47784246f31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA52308',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 150233,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-23',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-29 10:43:18 [auto1.de] INFO: Saving data for EA52308: {'auction_closing_time': 1774885182.0, 'created_time': 1774694051.400092, 'last_price_update_time': 1774780998.561124}
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA52308') HTTP/1.1" 204 0
2026-03-29 10:43:18 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-29 10:43:18 [auto1.de] INFO: Scrape type for KD45426: 2
2026-03-29 10:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-29 10:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4bc764-7243-5587-b194-1babaecb520b with scrape type 2
2026-03-29 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa4bc764-7243-5587-b194-1babaecb520b with scrape type 2
2026-03-29 10:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa4bc764-7243-5587-b194-1babaecb520b, identifier: KD45426
2026-03-29 10:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-29 10:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426
2026-03-29 10:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa4bc764-7243-5587-b194-1babaecb520b with identifier: KD45426 to the API
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:35:24Z',
'fuel_type': 'petrol',
'id': 'fa4bc764-7243-5587-b194-1babaecb520b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD45426',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 141760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-30',
'seller_name': None,
'title': 'BMW 3er 318i',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-29 10:43:18 [auto1.de] INFO: Saving data for KD45426: {'auction_closing_time': 1774884924.0, 'created_time': 1774694041.978312, 'last_price_update_time': 1774780998.97011}
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD45426') HTTP/1.1" 204 0
2026-03-29 10:43:18 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-29 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-29 10:43:19 [auto1.de] INFO: Scrape type for VZ43833: 2
2026-03-29 10:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-29 10:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91311945-c782-5129-99f1-86f0e2beccdd with scrape type 2
2026-03-29 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91311945-c782-5129-99f1-86f0e2beccdd with scrape type 2
2026-03-29 10:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91311945-c782-5129-99f1-86f0e2beccdd, identifier: VZ43833
2026-03-29 10:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-29 10:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833
2026-03-29 10:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91311945-c782-5129-99f1-86f0e2beccdd with identifier: VZ43833 to the API
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:11:47Z',
'fuel_type': 'petrol',
'id': '91311945-c782-5129-99f1-86f0e2beccdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ43833',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 167392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2006}
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-29 10:43:19 [auto1.de] INFO: Saving data for VZ43833: {'auction_closing_time': 1774883507.0, 'created_time': 1774694024.004512, 'last_price_update_time': 1774780999.385707}
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ43833') HTTP/1.1" 204 0
2026-03-29 10:43:19 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-29 10:43:19 [auto1.de] INFO: Scrape type for HA56884: 2
2026-03-29 10:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-29 10:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with scrape type 2
2026-03-29 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with scrape type 2
2026-03-29 10:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe, identifier: HA56884
2026-03-29 10:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-29 10:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884
2026-03-29 10:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54e674f2-ef7a-5dc7-8567-a348a4a1f7fe with identifier: HA56884 to the API
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:41:43Z',
'fuel_type': 'petrol',
'id': '54e674f2-ef7a-5dc7-8567-a348a4a1f7fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA56884',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 124438,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-14',
'seller_name': None,
'title': 'Peugeot 207 1.6 Roland Garros',
'transmission': 'manual',
'trim': 'Roland Garros',
'year': 2012}
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-29 10:43:19 [auto1.de] INFO: Saving data for HA56884: {'auction_closing_time': 1774885303.0, 'created_time': 1774694050.638559, 'last_price_update_time': 1774780999.805285}
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA56884') HTTP/1.1" 204 0
2026-03-29 10:43:19 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-29 10:43:19 [auto1.de] INFO: Scrape type for FD80393: 2
2026-03-29 10:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-29 10:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd515e07-5960-5374-8338-10aced789a66 with scrape type 2
2026-03-29 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd515e07-5960-5374-8338-10aced789a66 with scrape type 2
2026-03-29 10:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd515e07-5960-5374-8338-10aced789a66, identifier: FD80393
2026-03-29 10:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-29 10:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393
2026-03-29 10:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd515e07-5960-5374-8338-10aced789a66 with identifier: FD80393 to the API
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:01:27Z',
'fuel_type': 'diesel',
'id': 'fd515e07-5960-5374-8338-10aced789a66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD80393',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 247605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-11',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2012}
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-29 10:43:20 [auto1.de] INFO: Saving data for FD80393: {'auction_closing_time': 1774882887.0, 'created_time': 1774694030.039177, 'last_price_update_time': 1774781000.204873}
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD80393') HTTP/1.1" 204 0
2026-03-29 10:43:20 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-29 10:43:20 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-29 10:43:20 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-29 10:43:20 [auto1.de] INFO: Scrape type for XB41121: 2
2026-03-29 10:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-29 10:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b36653d-e2c2-5ecd-9011-c67d17418b68 with scrape type 2
2026-03-29 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b36653d-e2c2-5ecd-9011-c67d17418b68 with scrape type 2
2026-03-29 10:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b36653d-e2c2-5ecd-9011-c67d17418b68, identifier: XB41121
2026-03-29 10:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-29 10:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121
2026-03-29 10:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b36653d-e2c2-5ecd-9011-c67d17418b68 with identifier: XB41121 to the API
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:42:16Z',
'fuel_type': 'petrol',
'id': '2b36653d-e2c2-5ecd-9011-c67d17418b68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB41121',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 77230,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-05',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-29 10:43:20 [auto1.de] INFO: Saving data for XB41121: {'auction_closing_time': 1774885336.0, 'created_time': 1774379326.006103, 'last_price_update_time': 1774781000.873482}
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB41121') HTTP/1.1" 204 0
2026-03-29 10:43:20 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-29 10:43:20 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-29 10:43:20 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-29 10:43:20 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-29 10:43:20 [auto1.de] INFO: Scrape type for DA22909: 2
2026-03-29 10:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-29 10:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d3a715-6266-5382-bf96-20a3a23861e4 with scrape type 2
2026-03-29 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d3a715-6266-5382-bf96-20a3a23861e4 with scrape type 2
2026-03-29 10:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d3a715-6266-5382-bf96-20a3a23861e4, identifier: DA22909
2026-03-29 10:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-29 10:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909
2026-03-29 10:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d3a715-6266-5382-bf96-20a3a23861e4 with identifier: DA22909 to the API
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:12:31Z',
'fuel_type': 'petrol',
'id': '32d3a715-6266-5382-bf96-20a3a23861e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA22909',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 132266,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2017}
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-29 10:43:21 [auto1.de] INFO: Saving data for DA22909: {'auction_closing_time': 1774883551.0, 'created_time': 1774694076.109429, 'last_price_update_time': 1774781001.424093}
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA22909') HTTP/1.1" 204 0
2026-03-29 10:43:21 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-29 10:43:21 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-29 10:43:21 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-29 10:43:21 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-29 10:43:21 [auto1.de] INFO: Scrape type for BF10429: 2
2026-03-29 10:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-29 10:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4af197-bd73-5e48-b752-38c65235f529 with scrape type 2
2026-03-29 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4af197-bd73-5e48-b752-38c65235f529 with scrape type 2
2026-03-29 10:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c4af197-bd73-5e48-b752-38c65235f529, identifier: BF10429
2026-03-29 10:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-29 10:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429
2026-03-29 10:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c4af197-bd73-5e48-b752-38c65235f529 with identifier: BF10429 to the API
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:15:16Z',
'fuel_type': 'petrol',
'id': '5c4af197-bd73-5e48-b752-38c65235f529',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF10429',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 203115,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-10',
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Limited',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2018}
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-29 10:43:21 [auto1.de] INFO: Saving data for BF10429: {'auction_closing_time': 1774883716.0, 'created_time': 1774694075.495649, 'last_price_update_time': 1774781001.823185}
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF10429') HTTP/1.1" 204 0
2026-03-29 10:43:21 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:21 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-29 10:43:21 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-29 10:43:21 [auto1.de] INFO: Scrape type for XY13632: 2
2026-03-29 10:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-29 10:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d71bd56-9b91-5743-99d5-0d6926000427 with scrape type 2
2026-03-29 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d71bd56-9b91-5743-99d5-0d6926000427 with scrape type 2
2026-03-29 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d71bd56-9b91-5743-99d5-0d6926000427, identifier: XY13632
2026-03-29 10:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-29 10:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632
2026-03-29 10:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d71bd56-9b91-5743-99d5-0d6926000427 with identifier: XY13632 to the API
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:06:44Z',
'fuel_type': 'petrol',
'id': '6d71bd56-9b91-5743-99d5-0d6926000427',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY13632',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 152900,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-28',
'seller_name': None,
'title': 'Renault Clio 1.2 Rip Curl',
'transmission': 'manual',
'trim': 'Rip Curl',
'year': 2009}
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-29 10:43:22 [auto1.de] INFO: Saving data for XY13632: {'auction_closing_time': 1774883204.0, 'created_time': 1774694076.721366, 'last_price_update_time': 1774781002.403261}
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY13632') HTTP/1.1" 204 0
2026-03-29 10:43:22 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-29 10:43:22 [auto1.de] INFO: Scrape type for RR37288: 2
2026-03-29 10:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-29 10:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233b6197-1e65-53ba-8d93-3013a775cd32 with scrape type 2
2026-03-29 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 233b6197-1e65-53ba-8d93-3013a775cd32 with scrape type 2
2026-03-29 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 233b6197-1e65-53ba-8d93-3013a775cd32, identifier: RR37288
2026-03-29 10:43:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:22 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-29 10:43:22 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-29 10:43:22 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-29 10:43:22 [auto1.de] INFO: Scrape type for MH64159: 2
2026-03-29 10:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-29 10:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with scrape type 2
2026-03-29 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with scrape type 2
2026-03-29 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b903a51-3219-55ce-8cbc-ffc7d2caa415, identifier: MH64159
2026-03-29 10:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-29 10:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288
2026-03-29 10:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 233b6197-1e65-53ba-8d93-3013a775cd32 with identifier: RR37288 to the API
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:31:00Z',
'fuel_type': 'diesel',
'id': '233b6197-1e65-53ba-8d93-3013a775cd32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR37288',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 269195,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-02',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2015}
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-29 10:43:22 [auto1.de] INFO: Saving data for RR37288: {'auction_closing_time': 1774884660.0, 'created_time': 1774349103.185941, 'last_price_update_time': 1774781002.968312}
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR37288') HTTP/1.1" 204 0
2026-03-29 10:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-29 10:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159
2026-03-29 10:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b903a51-3219-55ce-8cbc-ffc7d2caa415 with identifier: MH64159 to the API
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:57:00Z',
'fuel_type': 'petrol',
'id': '7b903a51-3219-55ce-8cbc-ffc7d2caa415',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH64159',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 62072,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-12-31',
'seller_name': None,
'title': 'Renault Clio 1.2 Chiemsee',
'transmission': 'manual',
'trim': 'Chiemsee',
'year': 2002}
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-29 10:43:23 [auto1.de] INFO: Saving data for MH64159: {'auction_closing_time': 1774886220.0, 'created_time': 1774694062.558846, 'last_price_update_time': 1774781003.258831}
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH64159') HTTP/1.1" 204 0
2026-03-29 10:43:23 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-29 10:43:23 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-29 10:43:23 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-29 10:43:23 [auto1.de] INFO: Scrape type for XL20163: 2
2026-03-29 10:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-29 10:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d087450b-551e-5784-8900-034cc5670ac3 with scrape type 2
2026-03-29 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d087450b-551e-5784-8900-034cc5670ac3 with scrape type 2
2026-03-29 10:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d087450b-551e-5784-8900-034cc5670ac3, identifier: XL20163
2026-03-29 10:43:23 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-29 10:43:23 [auto1.de] INFO: Scrape type for CU51280: 2
2026-03-29 10:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-29 10:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2c65ce1-91d9-5ad7-be26-189437fdcd4d with scrape type 2
2026-03-29 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2c65ce1-91d9-5ad7-be26-189437fdcd4d with scrape type 2
2026-03-29 10:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2c65ce1-91d9-5ad7-be26-189437fdcd4d, identifier: CU51280
2026-03-29 10:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-29 10:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163
2026-03-29 10:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d087450b-551e-5784-8900-034cc5670ac3 with identifier: XL20163 to the API
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:51:16Z',
'fuel_type': 'petrol',
'id': 'd087450b-551e-5784-8900-034cc5670ac3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL20163',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 133363,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-10-14',
'seller_name': None,
'title': 'Volvo V70 2.5',
'transmission': 'automatic',
'trim': '',
'year': 1998}
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-29 10:43:23 [auto1.de] INFO: Saving data for XL20163: {'auction_closing_time': 1774885876.0, 'created_time': 1774694209.081186, 'last_price_update_time': 1774781003.797667}
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL20163') HTTP/1.1" 204 0
2026-03-29 10:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-29 10:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280
2026-03-29 10:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2c65ce1-91d9-5ad7-be26-189437fdcd4d with identifier: CU51280 to the API
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 347,
'expiration_date': '2026-03-30T15:38:40Z',
'fuel_type': 'diesel',
'id': 'e2c65ce1-91d9-5ad7-be26-189437fdcd4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU51280',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 196047,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-23',
'seller_name': None,
'title': 'Audi SQ5 3.0 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-29 10:43:24 [auto1.de] INFO: Saving data for CU51280: {'auction_closing_time': 1774885120.0, 'created_time': 1774034236.868814, 'last_price_update_time': 1774781004.106114}
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU51280') HTTP/1.1" 204 0
2026-03-29 10:43:24 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-29 10:43:24 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-29 10:43:24 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-29 10:43:24 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-29 10:43:24 [auto1.de] INFO: Scrape type for RW03523: 2
2026-03-29 10:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-29 10:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with scrape type 2
2026-03-29 10:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with scrape type 2
2026-03-29 10:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae, identifier: RW03523
2026-03-29 10:43:24 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-29 10:43:24 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-29 10:43:24 [auto1.de] INFO: Scrape type for TS47391: 2
2026-03-29 10:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-29 10:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with scrape type 2
2026-03-29 10:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with scrape type 2
2026-03-29 10:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5, identifier: TS47391
2026-03-29 10:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-29 10:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523
2026-03-29 10:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95b405e9-85af-5cdc-a4f4-7fec7227c6ae with identifier: RW03523 to the API
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 69,
'expiration_date': '2026-03-30T15:45:51Z',
'fuel_type': 'petrol',
'id': '95b405e9-85af-5cdc-a4f4-7fec7227c6ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW03523',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 39336,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'seller_name': None,
'title': 'Fiat 500C 1.0 Mild-Hybrid Dolcevita',
'transmission': 'manual',
'trim': 'Dolcevita',
'year': 2022}
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-29 10:43:24 [auto1.de] INFO: Saving data for RW03523: {'auction_closing_time': 1774885551.0, 'created_time': 1774694213.021457, 'last_price_update_time': 1774781004.646768}
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW03523') HTTP/1.1" 204 0
2026-03-29 10:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-29 10:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391
2026-03-29 10:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e074c97-29bd-5eb9-b797-cf5e32b11eb5 with identifier: TS47391 to the API
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:45:20Z',
'fuel_type': 'petrol',
'id': '9e074c97-29bd-5eb9-b797-cf5e32b11eb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS47391',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 148785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-23',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2015}
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-29 10:43:25 [auto1.de] INFO: Saving data for TS47391: {'auction_closing_time': 1774885520.0, 'created_time': 1774694049.978348, 'last_price_update_time': 1774781005.035088}
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS47391') HTTP/1.1" 204 0
2026-03-29 10:43:25 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-29 10:43:25 [auto1.de] INFO: Scrape type for ZY17523: 2
2026-03-29 10:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-29 10:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a718d79f-f2b7-5028-a2ad-de3486db6704 with scrape type 2
2026-03-29 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a718d79f-f2b7-5028-a2ad-de3486db6704 with scrape type 2
2026-03-29 10:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a718d79f-f2b7-5028-a2ad-de3486db6704, identifier: ZY17523
2026-03-29 10:43:25 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-29 10:43:25 [auto1.de] INFO: Scrape type for JD30879: 2
2026-03-29 10:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-29 10:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 986c93bc-34d3-51a7-a902-fd33bb552dce with scrape type 2
2026-03-29 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 986c93bc-34d3-51a7-a902-fd33bb552dce with scrape type 2
2026-03-29 10:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 986c93bc-34d3-51a7-a902-fd33bb552dce, identifier: JD30879
2026-03-29 10:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-29 10:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523
2026-03-29 10:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a718d79f-f2b7-5028-a2ad-de3486db6704 with identifier: ZY17523 to the API
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:05:09Z',
'fuel_type': 'petrol',
'id': 'a718d79f-f2b7-5028-a2ad-de3486db6704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY17523',
'listing': 'auction',
'make': 'Porsche',
'model': '911',
'odometer': 180792,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-06-30',
'seller_name': None,
'title': 'Porsche 911 996 Carrera',
'transmission': 'manual',
'trim': 'Carrera',
'year': 2001}
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-29 10:43:25 [auto1.de] INFO: Saving data for ZY17523: {'auction_closing_time': 1774883109.0, 'created_time': 1774694188.682929, 'last_price_update_time': 1774781005.559252}
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY17523') HTTP/1.1" 204 0
2026-03-29 10:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-29 10:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879
2026-03-29 10:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 986c93bc-34d3-51a7-a902-fd33bb552dce with identifier: JD30879 to the API
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:23:56Z',
'fuel_type': 'diesel',
'id': '986c93bc-34d3-51a7-a902-fd33bb552dce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD30879',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 182490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-09',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2019}
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-29 10:43:25 [auto1.de] INFO: Saving data for JD30879: {'auction_closing_time': 1774884236.0, 'created_time': 1773426835.783957, 'last_price_update_time': 1774781005.870723}
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD30879') HTTP/1.1" 204 0
2026-03-29 10:43:25 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-29 10:43:25 [auto1.de] INFO: Scrape type for GW53776: 2
2026-03-29 10:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-29 10:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384a9e63-8737-5102-a5a5-34fd13756f2b with scrape type 2
2026-03-29 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 384a9e63-8737-5102-a5a5-34fd13756f2b with scrape type 2
2026-03-29 10:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 384a9e63-8737-5102-a5a5-34fd13756f2b, identifier: GW53776
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-29 10:43:26 [auto1.de] INFO: Scrape type for ZF87196: 2
2026-03-29 10:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-29 10:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e with scrape type 2
2026-03-29 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6d0b9f5-b770-5530-a841-cc4d0b3d567e with scrape type 2
2026-03-29 10:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6d0b9f5-b770-5530-a841-cc4d0b3d567e, identifier: ZF87196
2026-03-29 10:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-29 10:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776
2026-03-29 10:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 384a9e63-8737-5102-a5a5-34fd13756f2b with identifier: GW53776 to the API
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:48:04Z',
'fuel_type': 'petrol',
'id': '384a9e63-8737-5102-a5a5-34fd13756f2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW53776',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 46165,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-06',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 Goal',
'transmission': 'automatic',
'trim': 'Goal',
'year': 2006}
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-29 10:43:26 [auto1.de] INFO: Saving data for GW53776: {'auction_closing_time': 1774885684.0, 'created_time': 1774694211.854835, 'last_price_update_time': 1774781006.396458}
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW53776') HTTP/1.1" 204 0
2026-03-29 10:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-29 10:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196
2026-03-29 10:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6d0b9f5-b770-5530-a841-cc4d0b3d567e with identifier: ZF87196 to the API
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:27:30Z',
'fuel_type': 'petrol',
'id': 'd6d0b9f5-b770-5530-a841-cc4d0b3d567e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF87196',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 170246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-02',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-29 10:43:26 [auto1.de] INFO: Saving data for ZF87196: {'auction_closing_time': 1774884450.0, 'created_time': 1774694176.87768, 'last_price_update_time': 1774781006.756082}
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF87196') HTTP/1.1" 204 0
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-29 10:43:26 [auto1.de] INFO: Scrape type for PH41345: 2
2026-03-29 10:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-29 10:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ab0d43-02be-57de-8893-7f844ef04211 with scrape type 2
2026-03-29 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85ab0d43-02be-57de-8893-7f844ef04211 with scrape type 2
2026-03-29 10:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85ab0d43-02be-57de-8893-7f844ef04211, identifier: PH41345
2026-03-29 10:43:26 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-29 10:43:26 [auto1.de] INFO: Scrape type for DK10749: 2
2026-03-29 10:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-29 10:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with scrape type 2
2026-03-29 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with scrape type 2
2026-03-29 10:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651, identifier: DK10749
2026-03-29 10:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-29 10:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345
2026-03-29 10:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85ab0d43-02be-57de-8893-7f844ef04211 with identifier: PH41345 to the API
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:42:51Z',
'fuel_type': 'petrol',
'id': '85ab0d43-02be-57de-8893-7f844ef04211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH41345',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 210335,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-29',
'seller_name': None,
'title': 'Honda Civic 1.4 Type S',
'transmission': 'manual',
'trim': 'Type S',
'year': 2009}
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-29 10:43:27 [auto1.de] INFO: Saving data for PH41345: {'auction_closing_time': 1774885371.0, 'created_time': 1774034140.5483, 'last_price_update_time': 1774781007.316686}
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH41345') HTTP/1.1" 204 0
2026-03-29 10:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-29 10:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749
2026-03-29 10:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aeb3d03-ea10-5f2f-96bb-3b626b36a651 with identifier: DK10749 to the API
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 121,
'expiration_date': '2026-03-30T15:43:08Z',
'fuel_type': 'diesel',
'id': '7aeb3d03-ea10-5f2f-96bb-3b626b36a651',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK10749',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 132308,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-27',
'seller_name': None,
'title': 'Renault Trafic 1.6 dCi L2H1 2,9t Expression',
'transmission': 'manual',
'trim': 'L2H1 2,9t Expression',
'year': 2019}
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-29 10:43:27 [auto1.de] INFO: Saving data for DK10749: {'auction_closing_time': 1774885388.0, 'created_time': 1773427370.390544, 'last_price_update_time': 1774781007.710186}
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK10749') HTTP/1.1" 204 0
2026-03-29 10:43:27 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-29 10:43:27 [auto1.de] INFO: Scrape type for FB79072: 2
2026-03-29 10:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-29 10:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with scrape type 2
2026-03-29 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with scrape type 2
2026-03-29 10:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb, identifier: FB79072
2026-03-29 10:43:27 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-29 10:43:27 [auto1.de] INFO: Scrape type for DD00982: 2
2026-03-29 10:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-29 10:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e6e885-b7f9-53e4-aa92-4466c522b74d with scrape type 2
2026-03-29 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e6e885-b7f9-53e4-aa92-4466c522b74d with scrape type 2
2026-03-29 10:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e6e885-b7f9-53e4-aa92-4466c522b74d, identifier: DD00982
2026-03-29 10:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-29 10:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072
2026-03-29 10:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb with identifier: FB79072 to the API
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:38:06Z',
'fuel_type': 'diesel',
'id': 'eb4caf8e-04b1-57b3-9e6d-1e0e9adb08bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB79072',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 231923,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-10',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-29 10:43:28 [auto1.de] INFO: Saving data for FB79072: {'auction_closing_time': 1774885086.0, 'created_time': 1774694061.48237, 'last_price_update_time': 1774781008.449065}
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB79072') HTTP/1.1" 204 0
2026-03-29 10:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-29 10:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982
2026-03-29 10:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e6e885-b7f9-53e4-aa92-4466c522b74d with identifier: DD00982 to the API
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:28:38Z',
'fuel_type': 'diesel',
'id': 'c6e6e885-b7f9-53e4-aa92-4466c522b74d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD00982',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 166112,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-03',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-29 10:43:28 [auto1.de] INFO: Saving data for DD00982: {'auction_closing_time': 1774884518.0, 'created_time': 1774694087.022759, 'last_price_update_time': 1774781008.748273}
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD00982') HTTP/1.1" 204 0
2026-03-29 10:43:28 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-29 10:43:28 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-29 10:43:28 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-29 10:43:28 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-29 10:43:28 [auto1.de] INFO: Scrape type for KW07987: 2
2026-03-29 10:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-29 10:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc3caa2-5686-523e-90f6-99682665dcf9 with scrape type 2
2026-03-29 10:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc3caa2-5686-523e-90f6-99682665dcf9 with scrape type 2
2026-03-29 10:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cc3caa2-5686-523e-90f6-99682665dcf9, identifier: KW07987
2026-03-29 10:43:28 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-29 10:43:28 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-29 10:43:28 [auto1.de] INFO: Scrape type for JV93942: 2
2026-03-29 10:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-29 10:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with scrape type 2
2026-03-29 10:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with scrape type 2
2026-03-29 10:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3, identifier: JV93942
2026-03-29 10:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-29 10:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987
2026-03-29 10:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cc3caa2-5686-523e-90f6-99682665dcf9 with identifier: KW07987 to the API
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:55:20Z',
'fuel_type': 'diesel',
'id': '4cc3caa2-5686-523e-90f6-99682665dcf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW07987',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 180923,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-27',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2013}
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-29 10:43:29 [auto1.de] INFO: Saving data for KW07987: {'auction_closing_time': 1774886120.0, 'created_time': 1774694049.078762, 'last_price_update_time': 1774781009.285382}
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW07987') HTTP/1.1" 204 0
2026-03-29 10:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-29 10:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942
2026-03-29 10:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9398a5d0-2ff1-589f-95af-e3891ec6f6d3 with identifier: JV93942 to the API
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:41:08Z',
'fuel_type': 'petrol',
'id': '9398a5d0-2ff1-589f-95af-e3891ec6f6d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV93942',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 50050,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-21',
'seller_name': None,
'title': 'Suzuki Swift 1.4 BoosterJet Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2019}
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-29 10:43:29 [auto1.de] INFO: Saving data for JV93942: {'auction_closing_time': 1774885268.0, 'created_time': 1774694205.414746, 'last_price_update_time': 1774781009.60654}
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV93942') HTTP/1.1" 204 0
2026-03-29 10:43:29 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-29 10:43:29 [auto1.de] INFO: Scrape type for HC06893: 2
2026-03-29 10:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-29 10:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with scrape type 2
2026-03-29 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with scrape type 2
2026-03-29 10:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0, identifier: HC06893
2026-03-29 10:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-29 10:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893
2026-03-29 10:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43ee5ac4-19e2-58ca-8887-fa2d79f8eac0 with identifier: HC06893 to the API
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:57:55Z',
'fuel_type': 'petrol',
'id': '43ee5ac4-19e2-58ca-8887-fa2d79f8eac0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC06893',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLK-Klasse',
'odometer': 110417,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-14',
'seller_name': None,
'title': 'Mercedes-Benz CLK-Klasse CLK 280 Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2005}
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-29 10:43:30 [auto1.de] INFO: Saving data for HC06893: {'auction_closing_time': 1774886275.0, 'created_time': 1773468614.674972, 'last_price_update_time': 1774781010.000557}
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC06893') HTTP/1.1" 204 0
2026-03-29 10:43:30 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:30 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-29 10:43:30 [auto1.de] INFO: Scrape type for BM85402: 2
2026-03-29 10:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-29 10:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with scrape type 2
2026-03-29 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with scrape type 2
2026-03-29 10:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12, identifier: BM85402
2026-03-29 10:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-29 10:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402
2026-03-29 10:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e824cdae-8ff0-5fd8-a2bc-9589ffa65c12 with identifier: BM85402 to the API
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:56:00Z',
'fuel_type': 'petrol',
'id': 'e824cdae-8ff0-5fd8-a2bc-9589ffa65c12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM85402',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 107368,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-22',
'seller_name': None,
'title': 'Peugeot 207 1.4 Urban Move',
'transmission': 'manual',
'trim': 'Urban Move',
'year': 2009}
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-29 10:43:30 [auto1.de] INFO: Saving data for BM85402: {'auction_closing_time': 1774886160.0, 'created_time': 1774694066.919696, 'last_price_update_time': 1774781010.409288}
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM85402') HTTP/1.1" 204 0
2026-03-29 10:43:30 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-29 10:43:30 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-29 10:43:30 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-29 10:43:30 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-29 10:43:30 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-29 10:43:30 [auto1.de] INFO: Scrape type for AD09354: 2
2026-03-29 10:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-29 10:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with scrape type 2
2026-03-29 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with scrape type 2
2026-03-29 10:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15a9a5af-84fd-5697-90e4-bbb7b99220a5, identifier: AD09354
2026-03-29 10:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:30 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-29 10:43:30 [auto1.de] INFO: Scrape type for CA67550: 2
2026-03-29 10:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-29 10:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e with scrape type 2
2026-03-29 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb41ac90-c3b7-5844-82da-020b8dbc5e1e with scrape type 2
2026-03-29 10:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb41ac90-c3b7-5844-82da-020b8dbc5e1e, identifier: CA67550
2026-03-29 10:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-29 10:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354
2026-03-29 10:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15a9a5af-84fd-5697-90e4-bbb7b99220a5 with identifier: AD09354 to the API
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:17:55Z',
'fuel_type': 'diesel',
'id': '15a9a5af-84fd-5697-90e4-bbb7b99220a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD09354',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 138977,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-05',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2016}
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-29 10:43:30 [auto1.de] INFO: Saving data for AD09354: {'auction_closing_time': 1774883875.0, 'created_time': 1774694068.941724, 'last_price_update_time': 1774781010.912266}
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD09354') HTTP/1.1" 204 0
2026-03-29 10:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-29 10:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550
2026-03-29 10:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb41ac90-c3b7-5844-82da-020b8dbc5e1e with identifier: CA67550 to the API
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:48:49Z',
'fuel_type': 'petrol',
'id': 'eb41ac90-c3b7-5844-82da-020b8dbc5e1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA67550',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 98353,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-31',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2016}
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-29 10:43:31 [auto1.de] INFO: Saving data for CA67550: {'auction_closing_time': 1774885729.0, 'created_time': 1774694053.661458, 'last_price_update_time': 1774781011.515305}
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA67550') HTTP/1.1" 204 0
2026-03-29 10:43:31 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-29 10:43:31 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-29 10:43:31 [auto1.de] INFO: Scrape type for YD36788: 2
2026-03-29 10:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-29 10:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81aad7f-8e28-569e-b293-8a98f3cb0996 with scrape type 2
2026-03-29 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b81aad7f-8e28-569e-b293-8a98f3cb0996 with scrape type 2
2026-03-29 10:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b81aad7f-8e28-569e-b293-8a98f3cb0996, identifier: YD36788
2026-03-29 10:43:31 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-29 10:43:31 [auto1.de] INFO: Scrape type for ZG02351: 2
2026-03-29 10:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-29 10:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c20aeb-4309-5876-a266-66a51436cbe6 with scrape type 2
2026-03-29 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c20aeb-4309-5876-a266-66a51436cbe6 with scrape type 2
2026-03-29 10:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54c20aeb-4309-5876-a266-66a51436cbe6, identifier: ZG02351
2026-03-29 10:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-29 10:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788
2026-03-29 10:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b81aad7f-8e28-569e-b293-8a98f3cb0996 with identifier: YD36788 to the API
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:36:06Z',
'fuel_type': 'petrol',
'id': 'b81aad7f-8e28-569e-b293-8a98f3cb0996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD36788',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 185392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-06-28',
'seller_name': None,
'title': 'Ford Fiesta 1.3 Fun',
'transmission': 'manual',
'trim': 'Fun',
'year': 2006}
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-29 10:43:32 [auto1.de] INFO: Saving data for YD36788: {'auction_closing_time': 1774884966.0, 'created_time': 1774694065.856895, 'last_price_update_time': 1774781012.041773}
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD36788') HTTP/1.1" 204 0
2026-03-29 10:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-29 10:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351
2026-03-29 10:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54c20aeb-4309-5876-a266-66a51436cbe6 with identifier: ZG02351 to the API
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:17Z',
'fuel_type': 'diesel',
'id': '54c20aeb-4309-5876-a266-66a51436cbe6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG02351',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 167168,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-26',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2018}
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-29 10:43:32 [auto1.de] INFO: Saving data for ZG02351: {'auction_closing_time': 1774885637.0, 'created_time': 1773467251.130645, 'last_price_update_time': 1774781012.356316}
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG02351') HTTP/1.1" 204 0
2026-03-29 10:43:32 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-29 10:43:32 [auto1.de] INFO: Scrape type for EY64053: 2
2026-03-29 10:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-29 10:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03eda04a-a574-5803-a3df-93d480f8bd52 with scrape type 2
2026-03-29 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03eda04a-a574-5803-a3df-93d480f8bd52 with scrape type 2
2026-03-29 10:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03eda04a-a574-5803-a3df-93d480f8bd52, identifier: EY64053
2026-03-29 10:43:32 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-29 10:43:32 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-29 10:43:32 [auto1.de] INFO: Scrape type for UK87241: 2
2026-03-29 10:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-29 10:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with scrape type 2
2026-03-29 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with scrape type 2
2026-03-29 10:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22b1e385-5bd9-5cf9-9f7a-77381ab83043, identifier: UK87241
2026-03-29 10:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-29 10:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053
2026-03-29 10:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03eda04a-a574-5803-a3df-93d480f8bd52 with identifier: EY64053 to the API
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:44Z',
'fuel_type': 'petrol',
'id': '03eda04a-a574-5803-a3df-93d480f8bd52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY64053',
'listing': 'auction',
'make': 'Subaru',
'model': 'Forester',
'odometer': 42316,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-22',
'seller_name': None,
'title': 'Subaru Forester 2.0 Mild-Hybrid Edition Sport40',
'transmission': 'automatic',
'trim': 'Edition Sport40',
'year': 2021}
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-29 10:43:32 [auto1.de] INFO: Saving data for EY64053: {'auction_closing_time': 1774882964.0, 'created_time': 1774694072.32255, 'last_price_update_time': 1774781012.8906}
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY64053') HTTP/1.1" 204 0
2026-03-29 10:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-29 10:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241
2026-03-29 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22b1e385-5bd9-5cf9-9f7a-77381ab83043 with identifier: UK87241 to the API
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:01:29Z',
'fuel_type': 'petrol',
'id': '22b1e385-5bd9-5cf9-9f7a-77381ab83043',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK87241',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 136106,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-27',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TFSI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2013}
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-29 10:43:33 [auto1.de] INFO: Saving data for UK87241: {'auction_closing_time': 1774882889.0, 'created_time': 1774694078.650329, 'last_price_update_time': 1774781013.218038}
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK87241') HTTP/1.1" 204 0
2026-03-29 10:43:33 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-29 10:43:33 [auto1.de] INFO: Scrape type for NK14391: 2
2026-03-29 10:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-29 10:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb38948e-5a13-5b35-b748-8ede486b53b7 with scrape type 2
2026-03-29 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb38948e-5a13-5b35-b748-8ede486b53b7 with scrape type 2
2026-03-29 10:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb38948e-5a13-5b35-b748-8ede486b53b7, identifier: NK14391
2026-03-29 10:43:33 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-29 10:43:33 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-29 10:43:33 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-29 10:43:33 [auto1.de] INFO: Scrape type for PJ27517: 2
2026-03-29 10:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-29 10:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2752d5-bd08-5c65-a7f9-0cc37aeb259d with scrape type 2
2026-03-29 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2752d5-bd08-5c65-a7f9-0cc37aeb259d with scrape type 2
2026-03-29 10:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da2752d5-bd08-5c65-a7f9-0cc37aeb259d, identifier: PJ27517
2026-03-29 10:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-29 10:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391
2026-03-29 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb38948e-5a13-5b35-b748-8ede486b53b7 with identifier: NK14391 to the API
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:51Z',
'fuel_type': 'petrol',
'id': 'bb38948e-5a13-5b35-b748-8ede486b53b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK14391',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 182979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-06',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 170',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-29 10:43:33 [auto1.de] INFO: Saving data for NK14391: {'auction_closing_time': 1774883871.0, 'created_time': 1774694069.355559, 'last_price_update_time': 1774781013.782036}
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK14391') HTTP/1.1" 204 0
2026-03-29 10:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-29 10:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517
2026-03-29 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da2752d5-bd08-5c65-a7f9-0cc37aeb259d with identifier: PJ27517 to the API
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 193,
'expiration_date': '2026-03-30T15:06:21Z',
'fuel_type': 'petrol',
'id': 'da2752d5-bd08-5c65-a7f9-0cc37aeb259d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ27517',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 16544,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-10-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Mild-Hybrid Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2024}
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-29 10:43:34 [auto1.de] INFO: Saving data for PJ27517: {'auction_closing_time': 1774883181.0, 'created_time': 1774350281.849803, 'last_price_update_time': 1774781014.109434}
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ27517') HTTP/1.1" 204 0
2026-03-29 10:43:34 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-29 10:43:34 [auto1.de] INFO: Scrape type for HA88960: 2
2026-03-29 10:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-29 10:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with scrape type 2
2026-03-29 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with scrape type 2
2026-03-29 10:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3, identifier: HA88960
2026-03-29 10:43:34 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-29 10:43:34 [auto1.de] INFO: Scrape type for MN00804: 2
2026-03-29 10:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-29 10:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd08d62-e04d-59c5-a09a-0a28284a469d with scrape type 2
2026-03-29 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afd08d62-e04d-59c5-a09a-0a28284a469d with scrape type 2
2026-03-29 10:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afd08d62-e04d-59c5-a09a-0a28284a469d, identifier: MN00804
2026-03-29 10:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-29 10:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960
2026-03-29 10:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e727d63-6f2d-5957-8f00-a46b2fe5e7e3 with identifier: HA88960 to the API
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:19:37Z',
'fuel_type': 'petrol',
'id': '3e727d63-6f2d-5957-8f00-a46b2fe5e7e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA88960',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 237990,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-19',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-29 10:43:34 [auto1.de] INFO: Saving data for HA88960: {'auction_closing_time': 1774883977.0, 'created_time': 1774694069.983274, 'last_price_update_time': 1774781014.684302}
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA88960') HTTP/1.1" 204 0
2026-03-29 10:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-29 10:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804
2026-03-29 10:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afd08d62-e04d-59c5-a09a-0a28284a469d with identifier: MN00804 to the API
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:32:23Z',
'fuel_type': 'petrol',
'id': 'afd08d62-e04d-59c5-a09a-0a28284a469d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN00804',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 180256,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-19',
'seller_name': None,
'title': 'BMW X1 sDrive 18i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2016}
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-29 10:43:35 [auto1.de] INFO: Saving data for MN00804: {'auction_closing_time': 1774884743.0, 'created_time': 1774694047.652062, 'last_price_update_time': 1774781015.087639}
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN00804') HTTP/1.1" 204 0
2026-03-29 10:43:35 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-29 10:43:35 [auto1.de] INFO: Scrape type for CV20886: 2
2026-03-29 10:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-29 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1997982-b8ac-5f76-816e-ddc917d75208 with scrape type 2
2026-03-29 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1997982-b8ac-5f76-816e-ddc917d75208 with scrape type 2
2026-03-29 10:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1997982-b8ac-5f76-816e-ddc917d75208, identifier: CV20886
2026-03-29 10:43:35 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-29 10:43:35 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-29 10:43:35 [auto1.de] INFO: Scrape type for GH25955: 2
2026-03-29 10:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-29 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399c574b-d314-5e64-898d-9b6abd286a56 with scrape type 2
2026-03-29 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 399c574b-d314-5e64-898d-9b6abd286a56 with scrape type 2
2026-03-29 10:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 399c574b-d314-5e64-898d-9b6abd286a56, identifier: GH25955
2026-03-29 10:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-29 10:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886
2026-03-29 10:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1997982-b8ac-5f76-816e-ddc917d75208 with identifier: CV20886 to the API
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:51:56Z',
'fuel_type': 'diesel',
'id': 'b1997982-b8ac-5f76-816e-ddc917d75208',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV20886',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 136386,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-28',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro Ambition',
'transmission': 'automatic',
'trim': 'quattro Ambition',
'year': 2013}
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-29 10:43:35 [auto1.de] INFO: Saving data for CV20886: {'auction_closing_time': 1774885916.0, 'created_time': 1774694068.528611, 'last_price_update_time': 1774781015.607082}
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV20886') HTTP/1.1" 204 0
2026-03-29 10:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-29 10:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955
2026-03-29 10:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 399c574b-d314-5e64-898d-9b6abd286a56 with identifier: GH25955 to the API
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:17:09Z',
'fuel_type': 'diesel',
'id': '399c574b-d314-5e64-898d-9b6abd286a56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH25955',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 137748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-11',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi Platinum Edition 4WD',
'transmission': 'automatic',
'trim': 'Platinum Edition 4WD',
'year': 2014}
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-29 10:43:35 [auto1.de] INFO: Saving data for GH25955: {'auction_closing_time': 1774883829.0, 'created_time': 1774349915.017703, 'last_price_update_time': 1774781015.906063}
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH25955') HTTP/1.1" 204 0
2026-03-29 10:43:35 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-29 10:43:35 [auto1.de] INFO: Scrape type for BF20079: 2
2026-03-29 10:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-29 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with scrape type 2
2026-03-29 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with scrape type 2
2026-03-29 10:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b754d76a-4fe3-54a0-b42a-64d9c1b640f9, identifier: BF20079
2026-03-29 10:43:36 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-29 10:43:36 [auto1.de] INFO: Scrape type for AF81396: 2
2026-03-29 10:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-29 10:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with scrape type 2
2026-03-29 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with scrape type 2
2026-03-29 10:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b62c02c-ca5b-5358-a986-8d8e1156bae0, identifier: AF81396
2026-03-29 10:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-29 10:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079
2026-03-29 10:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b754d76a-4fe3-54a0-b42a-64d9c1b640f9 with identifier: BF20079 to the API
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:51:44Z',
'fuel_type': 'petrol',
'id': 'b754d76a-4fe3-54a0-b42a-64d9c1b640f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF20079',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 157126,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-30',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
'transmission': 'automatic',
'trim': 'GTI BlueMotion',
'year': 2018}
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-29 10:43:36 [auto1.de] INFO: Saving data for BF20079: {'auction_closing_time': 1774885904.0, 'created_time': 1774694073.224824, 'last_price_update_time': 1774781016.42355}
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF20079') HTTP/1.1" 204 0
2026-03-29 10:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-29 10:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396
2026-03-29 10:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b62c02c-ca5b-5358-a986-8d8e1156bae0 with identifier: AF81396 to the API
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:53:51Z',
'fuel_type': 'petrol',
'id': '7b62c02c-ca5b-5358-a986-8d8e1156bae0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF81396',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 69525,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-06',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Edition BlueMotion Tech',
'transmission': 'manual',
'trim': 'Edition BlueMotion Tech',
'year': 2015}
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-29 10:43:36 [auto1.de] INFO: Saving data for AF81396: {'auction_closing_time': 1774886031.0, 'created_time': 1773467103.296941, 'last_price_update_time': 1774781016.719447}
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF81396') HTTP/1.1" 204 0
2026-03-29 10:43:36 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-29 10:43:36 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-29 10:43:36 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-29 10:43:36 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-29 10:43:36 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-29 10:43:36 [auto1.de] INFO: Scrape type for YH86831: 2
2026-03-29 10:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-29 10:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with scrape type 2
2026-03-29 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with scrape type 2
2026-03-29 10:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121, identifier: YH86831
2026-03-29 10:43:36 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-29 10:43:36 [auto1.de] INFO: Scrape type for FJ89028: 2
2026-03-29 10:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-29 10:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6fdad1-e21a-5820-9fae-a30a17add957 with scrape type 2
2026-03-29 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6fdad1-e21a-5820-9fae-a30a17add957 with scrape type 2
2026-03-29 10:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f6fdad1-e21a-5820-9fae-a30a17add957, identifier: FJ89028
2026-03-29 10:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-29 10:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831
2026-03-29 10:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 731a2dbc-6a6f-54bb-86fd-416c2bbb9121 with identifier: YH86831 to the API
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:47:12Z',
'fuel_type': 'diesel',
'id': '731a2dbc-6a6f-54bb-86fd-416c2bbb9121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH86831',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 177977,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-26',
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2013}
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-29 10:43:44 [auto1.de] INFO: Saving data for YH86831: {'auction_closing_time': 1774885632.0, 'created_time': 1774694072.797569, 'last_price_update_time': 1774781024.503275}
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH86831') HTTP/1.1" 204 0
2026-03-29 10:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-29 10:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028
2026-03-29 10:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f6fdad1-e21a-5820-9fae-a30a17add957 with identifier: FJ89028 to the API
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:21:30Z',
'fuel_type': 'hybrid',
'id': '0f6fdad1-e21a-5820-9fae-a30a17add957',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ89028',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 272614,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-16',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 300 de Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2019}
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-29 10:43:44 [auto1.de] INFO: Saving data for FJ89028: {'auction_closing_time': 1774884090.0, 'created_time': 1773401968.489246, 'last_price_update_time': 1774781024.926771}
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ89028') HTTP/1.1" 204 0
2026-03-29 10:43:44 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-29 10:43:44 [auto1.de] INFO: Scrape type for GU24004: 2
2026-03-29 10:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-29 10:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1ac83ee-d2d0-5830-bbad-b7457acecb1d with scrape type 2
2026-03-29 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1ac83ee-d2d0-5830-bbad-b7457acecb1d with scrape type 2
2026-03-29 10:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1ac83ee-d2d0-5830-bbad-b7457acecb1d, identifier: GU24004
2026-03-29 10:43:45 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-29 10:43:45 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-29 10:43:45 [auto1.de] INFO: Scrape type for GY71036: 2
2026-03-29 10:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-29 10:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1449c7c0-88ed-558a-b35c-64f012161f92 with scrape type 2
2026-03-29 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1449c7c0-88ed-558a-b35c-64f012161f92 with scrape type 2
2026-03-29 10:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1449c7c0-88ed-558a-b35c-64f012161f92, identifier: GY71036
2026-03-29 10:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-29 10:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004
2026-03-29 10:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1ac83ee-d2d0-5830-bbad-b7457acecb1d with identifier: GU24004 to the API
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:59:58Z',
'fuel_type': 'petrol',
'id': 'c1ac83ee-d2d0-5830-bbad-b7457acecb1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU24004',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 55588,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-01',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2008}
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-29 10:43:45 [auto1.de] INFO: Saving data for GU24004: {'auction_closing_time': 1774886398.0, 'created_time': 1774031449.386222, 'last_price_update_time': 1774781025.41872}
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU24004') HTTP/1.1" 204 0
2026-03-29 10:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-29 10:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036
2026-03-29 10:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1449c7c0-88ed-558a-b35c-64f012161f92 with identifier: GY71036 to the API
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:32:52Z',
'fuel_type': 'petrol',
'id': '1449c7c0-88ed-558a-b35c-64f012161f92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY71036',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 41702,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-05',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.2 Intro Edition+',
'transmission': 'manual',
'trim': 'Intro Edition+',
'year': 2020}
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-29 10:43:45 [auto1.de] INFO: Saving data for GY71036: {'auction_closing_time': 1774884772.0, 'created_time': 1774694063.367726, 'last_price_update_time': 1774781025.700301}
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY71036') HTTP/1.1" 204 0
2026-03-29 10:43:45 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-29 10:43:45 [auto1.de] INFO: Scrape type for KR12848: 2
2026-03-29 10:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-29 10:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e66d2369-84ab-5547-82d1-4404b80b8f02 with scrape type 2
2026-03-29 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e66d2369-84ab-5547-82d1-4404b80b8f02 with scrape type 2
2026-03-29 10:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e66d2369-84ab-5547-82d1-4404b80b8f02, identifier: KR12848
2026-03-29 10:43:45 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-29 10:43:45 [auto1.de] INFO: Scrape type for HB96226: 2
2026-03-29 10:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-29 10:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with scrape type 2
2026-03-29 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with scrape type 2
2026-03-29 10:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7, identifier: HB96226
2026-03-29 10:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-29 10:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848
2026-03-29 10:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e66d2369-84ab-5547-82d1-4404b80b8f02 with identifier: KR12848 to the API
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:02:06Z',
'fuel_type': 'petrol',
'id': 'e66d2369-84ab-5547-82d1-4404b80b8f02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR12848',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 89270,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-31',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.0 TSI',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-29 10:43:46 [auto1.de] INFO: Saving data for KR12848: {'auction_closing_time': 1774882926.0, 'created_time': 1773427823.4383, 'last_price_update_time': 1774781026.253416}
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR12848') HTTP/1.1" 204 0
2026-03-29 10:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-29 10:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226
2026-03-29 10:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7 with identifier: HB96226 to the API
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:37:24Z',
'fuel_type': 'diesel',
'id': '2c0f1333-4e86-5f6b-8a6a-b5f9e505d5b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB96226',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 221823,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-14',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2016}
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-29 10:43:46 [auto1.de] INFO: Saving data for HB96226: {'auction_closing_time': 1774885044.0, 'created_time': 1773426880.942882, 'last_price_update_time': 1774781026.544378}
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB96226') HTTP/1.1" 204 0
2026-03-29 10:43:46 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-29 10:43:46 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-29 10:43:46 [auto1.de] INFO: Scrape type for RR83304: 2
2026-03-29 10:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-29 10:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with scrape type 2
2026-03-29 10:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with scrape type 2
2026-03-29 10:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d, identifier: RR83304
2026-03-29 10:43:46 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-29 10:43:46 [auto1.de] INFO: Scrape type for GS36349: 2
2026-03-29 10:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-29 10:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with scrape type 2
2026-03-29 10:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with scrape type 2
2026-03-29 10:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad5b91dd-e884-5a51-9283-2e39b9dae6a3, identifier: GS36349
2026-03-29 10:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-29 10:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304
2026-03-29 10:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d with identifier: RR83304 to the API
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:41Z',
'fuel_type': 'petrol',
'id': '82d6ccf0-e9fd-5775-aa28-1c0d7681eb9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR83304',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 164389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-17',
'seller_name': None,
'title': 'Mazda 5 2.0 Sports-Line',
'transmission': 'manual',
'trim': 'Sports-Line',
'year': 2012}
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-29 10:43:47 [auto1.de] INFO: Saving data for RR83304: {'auction_closing_time': 1774884641.0, 'created_time': 1774694244.551026, 'last_price_update_time': 1774781027.055533}
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR83304') HTTP/1.1" 204 0
2026-03-29 10:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-29 10:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349
2026-03-29 10:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad5b91dd-e884-5a51-9283-2e39b9dae6a3 with identifier: GS36349 to the API
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:49:19Z',
'fuel_type': 'petrol',
'id': 'ad5b91dd-e884-5a51-9283-2e39b9dae6a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS36349',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-30',
'odometer': 50732,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-12',
'seller_name': None,
'title': 'Mazda CX-30 2.0 Skyactiv-G Mild-Hybrid Selection 2WD',
'transmission': 'automatic',
'trim': 'Selection 2WD',
'year': 2019}
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-29 10:43:47 [auto1.de] INFO: Saving data for GS36349: {'auction_closing_time': 1774885759.0, 'created_time': 1774032438.513994, 'last_price_update_time': 1774781027.3627}
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS36349') HTTP/1.1" 204 0
2026-03-29 10:43:47 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-29 10:43:47 [auto1.de] INFO: Scrape type for UE39516: 2
2026-03-29 10:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-29 10:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with scrape type 2
2026-03-29 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with scrape type 2
2026-03-29 10:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e, identifier: UE39516
2026-03-29 10:43:47 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-29 10:43:47 [auto1.de] INFO: Scrape type for HA50795: 2
2026-03-29 10:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-29 10:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7b8361-18dd-5948-9838-350ac5ee585e with scrape type 2
2026-03-29 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7b8361-18dd-5948-9838-350ac5ee585e with scrape type 2
2026-03-29 10:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc7b8361-18dd-5948-9838-350ac5ee585e, identifier: HA50795
2026-03-29 10:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-29 10:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516
2026-03-29 10:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e with identifier: UE39516 to the API
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:01:47Z',
'fuel_type': 'petrol',
'id': 'a164a1d8-30d6-5dd9-9f4d-8705fbee8d8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE39516',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 12585,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-27',
'seller_name': None,
'title': 'Suzuki Swift 1.2 Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2014}
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-29 10:43:47 [auto1.de] INFO: Saving data for UE39516: {'auction_closing_time': 1774882907.0, 'created_time': 1774694246.582082, 'last_price_update_time': 1774781027.884452}
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE39516') HTTP/1.1" 204 0
2026-03-29 10:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-29 10:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795
2026-03-29 10:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc7b8361-18dd-5948-9838-350ac5ee585e with identifier: HA50795 to the API
2026-03-29 10:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:57:19Z',
'fuel_type': 'diesel',
'id': 'fc7b8361-18dd-5948-9838-350ac5ee585e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA50795',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 90462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-04',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Trend',
'transmission': 'automatic',
'trim': '320 L2 Trend',
'year': 2019}
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-29 10:43:48 [auto1.de] INFO: Saving data for HA50795: {'auction_closing_time': 1774886239.0, 'created_time': 1774089338.447405, 'last_price_update_time': 1774781028.208878}
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA50795') HTTP/1.1" 204 0
2026-03-29 10:43:48 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-29 10:43:48 [auto1.de] INFO: Scrape type for GM93366: 2
2026-03-29 10:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-29 10:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab with scrape type 2
2026-03-29 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b8a18e4-a97b-570d-9d0c-32265795a1ab with scrape type 2
2026-03-29 10:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b8a18e4-a97b-570d-9d0c-32265795a1ab, identifier: GM93366
2026-03-29 10:43:48 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-29 10:43:48 [auto1.de] INFO: Scrape type for UZ55149: 2
2026-03-29 10:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-29 10:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with scrape type 2
2026-03-29 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with scrape type 2
2026-03-29 10:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46eb9f3e-63d4-5f4d-b705-acb3dd131886, identifier: UZ55149
2026-03-29 10:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-29 10:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366
2026-03-29 10:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b8a18e4-a97b-570d-9d0c-32265795a1ab with identifier: GM93366 to the API
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 71,
'expiration_date': '2026-03-30T15:19:41Z',
'fuel_type': 'petrol',
'id': '9b8a18e4-a97b-570d-9d0c-32265795a1ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM93366',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 56254,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-22',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.2 Select+',
'transmission': 'manual',
'trim': 'Select+',
'year': 2023}
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-29 10:43:48 [auto1.de] INFO: Saving data for GM93366: {'auction_closing_time': 1774883981.0, 'created_time': 1774694248.664675, 'last_price_update_time': 1774781028.72683}
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM93366') HTTP/1.1" 204 0
2026-03-29 10:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-29 10:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149
2026-03-29 10:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46eb9f3e-63d4-5f4d-b705-acb3dd131886 with identifier: UZ55149 to the API
2026-03-29 10:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:36:37Z',
'fuel_type': 'diesel',
'id': '46eb9f3e-63d4-5f4d-b705-acb3dd131886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ55149',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 188538,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-17',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
'transmission': 'manual',
'trim': 'Innovation Start/Stop',
'year': 2017}
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-29 10:43:49 [auto1.de] INFO: Saving data for UZ55149: {'auction_closing_time': 1774884997.0, 'created_time': 1774118803.908816, 'last_price_update_time': 1774781029.11554}
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ55149') HTTP/1.1" 204 0
2026-03-29 10:43:49 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-29 10:43:49 [auto1.de] INFO: Scrape type for VV13794: 2
2026-03-29 10:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-29 10:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with scrape type 2
2026-03-29 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with scrape type 2
2026-03-29 10:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b, identifier: VV13794
2026-03-29 10:43:49 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-29 10:43:49 [auto1.de] INFO: Scrape type for NC03535: 2
2026-03-29 10:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-29 10:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ad6f15-00d9-5c62-b030-072a353c5614 with scrape type 2
2026-03-29 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75ad6f15-00d9-5c62-b030-072a353c5614 with scrape type 2
2026-03-29 10:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75ad6f15-00d9-5c62-b030-072a353c5614, identifier: NC03535
2026-03-29 10:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-29 10:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794
2026-03-29 10:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2208c465-4e02-57a6-85a6-2a2d0f9f0d1b with identifier: VV13794 to the API
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:11:56Z',
'fuel_type': 'diesel',
'id': '2208c465-4e02-57a6-85a6-2a2d0f9f0d1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV13794',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 41839,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-05',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-29 10:43:49 [auto1.de] INFO: Saving data for VV13794: {'auction_closing_time': 1774883516.0, 'created_time': 1773302816.426452, 'last_price_update_time': 1774781029.699303}
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV13794') HTTP/1.1" 204 0
2026-03-29 10:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-29 10:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535
2026-03-29 10:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75ad6f15-00d9-5c62-b030-072a353c5614 with identifier: NC03535 to the API
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:21:01Z',
'fuel_type': 'diesel',
'id': '75ad6f15-00d9-5c62-b030-072a353c5614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC03535',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 111998,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-04',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Join',
'transmission': 'automatic',
'trim': 'Join',
'year': 2019}
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-29 10:43:50 [auto1.de] INFO: Saving data for NC03535: {'auction_closing_time': 1774884061.0, 'created_time': 1774349312.394359, 'last_price_update_time': 1774781030.039123}
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC03535') HTTP/1.1" 204 0
2026-03-29 10:43:50 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-29 10:43:50 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-29 10:43:50 [auto1.de] INFO: Scrape type for YZ93314: 2
2026-03-29 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-29 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with scrape type 2
2026-03-29 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with scrape type 2
2026-03-29 10:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d, identifier: YZ93314
2026-03-29 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:50 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-29 10:43:50 [auto1.de] INFO: Scrape type for HR22131: 2
2026-03-29 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-29 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with scrape type 2
2026-03-29 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with scrape type 2
2026-03-29 10:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053, identifier: HR22131
2026-03-29 10:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-29 10:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314
2026-03-29 10:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1dd039-1e61-50eb-a5cd-8c14f81b000d with identifier: YZ93314 to the API
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:37:35Z',
'fuel_type': 'diesel',
'id': '9d1dd039-1e61-50eb-a5cd-8c14f81b000d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ93314',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 126211,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-30',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2016}
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-29 10:43:50 [auto1.de] INFO: Saving data for YZ93314: {'auction_closing_time': 1774885055.0, 'created_time': 1774349599.288837, 'last_price_update_time': 1774781030.571462}
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ93314') HTTP/1.1" 204 0
2026-03-29 10:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-29 10:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131
2026-03-29 10:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c8e8731-4edb-5ec2-8286-1d6a4e1c9053 with identifier: HR22131 to the API
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:58:24Z',
'fuel_type': 'petrol',
'id': '4c8e8731-4edb-5ec2-8286-1d6a4e1c9053',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR22131',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 178361,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-07',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2012}
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-29 10:43:50 [auto1.de] INFO: Saving data for HR22131: {'auction_closing_time': 1774886304.0, 'created_time': 1774694204.171055, 'last_price_update_time': 1774781030.879222}
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR22131') HTTP/1.1" 204 0
2026-03-29 10:43:50 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-29 10:43:50 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-29 10:43:50 [auto1.de] INFO: Scrape type for ZE64138: 2
2026-03-29 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-29 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with scrape type 2
2026-03-29 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with scrape type 2
2026-03-29 10:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8, identifier: ZE64138
2026-03-29 10:43:51 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-29 10:43:51 [auto1.de] INFO: Scrape type for YM01256: 2
2026-03-29 10:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-29 10:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359cd182-fddc-5adb-907e-808bb578c25c with scrape type 2
2026-03-29 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 359cd182-fddc-5adb-907e-808bb578c25c with scrape type 2
2026-03-29 10:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 359cd182-fddc-5adb-907e-808bb578c25c, identifier: YM01256
2026-03-29 10:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-29 10:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138
2026-03-29 10:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8 with identifier: ZE64138 to the API
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:28:18Z',
'fuel_type': 'diesel',
'id': 'ce4a5e9d-0f2b-53bd-9824-ef9b5eabcac8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE64138',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 167222,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-23',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
'transmission': 'automatic',
'trim': 'Style 4x4',
'year': 2019}
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-29 10:43:51 [auto1.de] INFO: Saving data for ZE64138: {'auction_closing_time': 1774884498.0, 'created_time': 1773428711.309024, 'last_price_update_time': 1774781031.448118}
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE64138') HTTP/1.1" 204 0
2026-03-29 10:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-29 10:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256
2026-03-29 10:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 359cd182-fddc-5adb-907e-808bb578c25c with identifier: YM01256 to the API
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:13:45Z',
'fuel_type': 'diesel',
'id': '359cd182-fddc-5adb-907e-808bb578c25c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM01256',
'listing': 'auction',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 176943,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-12',
'seller_name': None,
'title': 'Jaguar E-Pace D240 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2020}
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-29 10:43:51 [auto1.de] INFO: Saving data for YM01256: {'auction_closing_time': 1774883625.0, 'created_time': 1774694185.415845, 'last_price_update_time': 1774781031.744825}
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM01256') HTTP/1.1" 204 0
2026-03-29 10:43:51 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-29 10:43:51 [auto1.de] INFO: Scrape type for FH72870: 2
2026-03-29 10:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-29 10:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86906fa7-6293-511d-94fc-741a93ab8427 with scrape type 2
2026-03-29 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86906fa7-6293-511d-94fc-741a93ab8427 with scrape type 2
2026-03-29 10:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86906fa7-6293-511d-94fc-741a93ab8427, identifier: FH72870
2026-03-29 10:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-29 10:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870
2026-03-29 10:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86906fa7-6293-511d-94fc-741a93ab8427 with identifier: FH72870 to the API
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:39:30Z',
'fuel_type': 'petrol',
'id': '86906fa7-6293-511d-94fc-741a93ab8427',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH72870',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 230943,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-26',
'seller_name': None,
'title': 'Volkswagen Beetle 2.0 TSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2012}
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-29 10:43:52 [auto1.de] INFO: Saving data for FH72870: {'auction_closing_time': 1774885170.0, 'created_time': 1774349732.154987, 'last_price_update_time': 1774781032.198136}
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH72870') HTTP/1.1" 204 0
2026-03-29 10:43:52 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:52 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-29 10:43:52 [auto1.de] INFO: Scrape type for RV36249: 2
2026-03-29 10:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-29 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db3db65-0326-572c-81bf-2393918dec44 with scrape type 2
2026-03-29 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db3db65-0326-572c-81bf-2393918dec44 with scrape type 2
2026-03-29 10:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1db3db65-0326-572c-81bf-2393918dec44, identifier: RV36249
2026-03-29 10:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-29 10:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249
2026-03-29 10:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1db3db65-0326-572c-81bf-2393918dec44 with identifier: RV36249 to the API
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:39:56Z',
'fuel_type': 'petrol',
'id': '1db3db65-0326-572c-81bf-2393918dec44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV36249',
'listing': 'auction',
'make': 'Audi',
'model': 'TT',
'odometer': 137396,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-05-15',
'seller_name': None,
'title': 'Audi TT 1.8 Turbo Roadster',
'transmission': 'manual',
'trim': 'Roadster',
'year': 2000}
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-29 10:43:52 [auto1.de] INFO: Saving data for RV36249: {'auction_closing_time': 1774885196.0, 'created_time': 1774694102.50061, 'last_price_update_time': 1774781032.596219}
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV36249') HTTP/1.1" 204 0
2026-03-29 10:43:52 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-29 10:43:52 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-29 10:43:52 [auto1.de] INFO: Scrape type for EC79074: 2
2026-03-29 10:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-29 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1daf73af-3354-5d41-a492-cd78cc06b189 with scrape type 2
2026-03-29 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1daf73af-3354-5d41-a492-cd78cc06b189 with scrape type 2
2026-03-29 10:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1daf73af-3354-5d41-a492-cd78cc06b189, identifier: EC79074
2026-03-29 10:43:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:52 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-29 10:43:52 [auto1.de] INFO: Scrape type for GR32471: 2
2026-03-29 10:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-29 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14343135-c4a8-59cd-a600-8b45a60a94b0 with scrape type 2
2026-03-29 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14343135-c4a8-59cd-a600-8b45a60a94b0 with scrape type 2
2026-03-29 10:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14343135-c4a8-59cd-a600-8b45a60a94b0, identifier: GR32471
2026-03-29 10:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-29 10:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074
2026-03-29 10:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1daf73af-3354-5d41-a492-cd78cc06b189 with identifier: EC79074 to the API
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:44Z',
'fuel_type': 'diesel',
'id': '1daf73af-3354-5d41-a492-cd78cc06b189',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC79074',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 324456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-13',
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-29 10:43:53 [auto1.de] INFO: Saving data for EC79074: {'auction_closing_time': 1774884224.0, 'created_time': 1774694105.757887, 'last_price_update_time': 1774781033.118258}
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC79074') HTTP/1.1" 204 0
2026-03-29 10:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-29 10:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471
2026-03-29 10:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14343135-c4a8-59cd-a600-8b45a60a94b0 with identifier: GR32471 to the API
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:15Z',
'fuel_type': 'petrol',
'id': '14343135-c4a8-59cd-a600-8b45a60a94b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR32471',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 48275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-16',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2019}
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-29 10:43:53 [auto1.de] INFO: Saving data for GR32471: {'auction_closing_time': 1774886055.0, 'created_time': 1774694093.798396, 'last_price_update_time': 1774781033.506391}
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR32471') HTTP/1.1" 204 0
2026-03-29 10:43:53 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-29 10:43:53 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-29 10:43:53 [auto1.de] INFO: Scrape type for KE20907: 2
2026-03-29 10:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-29 10:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030a247d-f685-53c6-abd3-6e27a13efc2e with scrape type 2
2026-03-29 10:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 030a247d-f685-53c6-abd3-6e27a13efc2e with scrape type 2
2026-03-29 10:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 030a247d-f685-53c6-abd3-6e27a13efc2e, identifier: KE20907
2026-03-29 10:43:53 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-29 10:43:53 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-29 10:43:53 [auto1.de] INFO: Scrape type for TJ69669: 2
2026-03-29 10:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-29 10:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9788a7-ace5-5900-a7e0-c3dd9f734d80 with scrape type 2
2026-03-29 10:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de9788a7-ace5-5900-a7e0-c3dd9f734d80 with scrape type 2
2026-03-29 10:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de9788a7-ace5-5900-a7e0-c3dd9f734d80, identifier: TJ69669
2026-03-29 10:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-29 10:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907
2026-03-29 10:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 030a247d-f685-53c6-abd3-6e27a13efc2e with identifier: KE20907 to the API
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:16Z',
'fuel_type': 'petrol',
'id': '030a247d-f685-53c6-abd3-6e27a13efc2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE20907',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 129421,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-30',
'seller_name': None,
'title': 'BMW X1 sDrive 18i',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-29 10:43:54 [auto1.de] INFO: Saving data for KE20907: {'auction_closing_time': 1774886296.0, 'created_time': 1774694321.230602, 'last_price_update_time': 1774781034.031658}
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE20907') HTTP/1.1" 204 0
2026-03-29 10:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-29 10:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669
2026-03-29 10:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de9788a7-ace5-5900-a7e0-c3dd9f734d80 with identifier: TJ69669 to the API
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:54:56Z',
'fuel_type': 'petrol',
'id': 'de9788a7-ace5-5900-a7e0-c3dd9f734d80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ69669',
'listing': 'auction',
'make': 'BMW',
'model': '7er',
'odometer': 213913,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-19',
'seller_name': None,
'title': 'BMW 7er 735i L',
'transmission': 'automatic',
'trim': 'L',
'year': 2004}
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-29 10:43:54 [auto1.de] INFO: Saving data for TJ69669: {'auction_closing_time': 1774886096.0, 'created_time': 1774694172.70101, 'last_price_update_time': 1774781034.340273}
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ69669') HTTP/1.1" 204 0
2026-03-29 10:43:54 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-29 10:43:54 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-29 10:43:54 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-29 10:43:54 [auto1.de] INFO: Scrape type for ZM57049: 2
2026-03-29 10:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-29 10:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac4764f-d828-590a-822d-84fb53c8f546 with scrape type 2
2026-03-29 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ac4764f-d828-590a-822d-84fb53c8f546 with scrape type 2
2026-03-29 10:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ac4764f-d828-590a-822d-84fb53c8f546, identifier: ZM57049
2026-03-29 10:43:54 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-29 10:43:54 [auto1.de] INFO: Scrape type for CX33153: 2
2026-03-29 10:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-29 10:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac2daf7a-7463-583c-b610-2b84de3ebca8 with scrape type 2
2026-03-29 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac2daf7a-7463-583c-b610-2b84de3ebca8 with scrape type 2
2026-03-29 10:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac2daf7a-7463-583c-b610-2b84de3ebca8, identifier: CX33153
2026-03-29 10:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-29 10:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049
2026-03-29 10:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ac4764f-d828-590a-822d-84fb53c8f546 with identifier: ZM57049 to the API
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:27:44Z',
'fuel_type': 'petrol',
'id': '7ac4764f-d828-590a-822d-84fb53c8f546',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM57049',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 263804,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-18',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2013}
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-29 10:43:54 [auto1.de] INFO: Saving data for ZM57049: {'auction_closing_time': 1774884464.0, 'created_time': 1774002630.422864, 'last_price_update_time': 1774781034.897295}
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM57049') HTTP/1.1" 204 0
2026-03-29 10:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-29 10:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153
2026-03-29 10:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac2daf7a-7463-583c-b610-2b84de3ebca8 with identifier: CX33153 to the API
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:30:02Z',
'fuel_type': 'diesel',
'id': 'ac2daf7a-7463-583c-b610-2b84de3ebca8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX33153',
'listing': 'auction',
'make': 'Volvo',
'model': 'V50',
'odometer': 205182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-15',
'seller_name': None,
'title': 'Volvo V50 1.6 D2 Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2012}
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-29 10:43:55 [auto1.de] INFO: Saving data for CX33153: {'auction_closing_time': 1774884602.0, 'created_time': 1774032868.602166, 'last_price_update_time': 1774781035.203496}
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX33153') HTTP/1.1" 204 0
2026-03-29 10:43:55 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-29 10:43:55 [auto1.de] INFO: Scrape type for KW41122: 2
2026-03-29 10:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-29 10:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cede8d43-5a9e-5af2-9b7e-31bdee79550a with scrape type 2
2026-03-29 10:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cede8d43-5a9e-5af2-9b7e-31bdee79550a with scrape type 2
2026-03-29 10:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cede8d43-5a9e-5af2-9b7e-31bdee79550a, identifier: KW41122
2026-03-29 10:43:55 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-29 10:43:55 [auto1.de] INFO: Scrape type for XL82798: 2
2026-03-29 10:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-29 10:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02ad922-971e-54a5-8fdc-c6567d88302d with scrape type 2
2026-03-29 10:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a02ad922-971e-54a5-8fdc-c6567d88302d with scrape type 2
2026-03-29 10:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a02ad922-971e-54a5-8fdc-c6567d88302d, identifier: XL82798
2026-03-29 10:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-29 10:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122
2026-03-29 10:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cede8d43-5a9e-5af2-9b7e-31bdee79550a with identifier: KW41122 to the API
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 84,
'expiration_date': '2026-03-30T15:26:06Z',
'fuel_type': 'petrol',
'id': 'cede8d43-5a9e-5af2-9b7e-31bdee79550a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW41122',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 64442,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-08',
'seller_name': None,
'title': 'Kia Picanto 1.2 Dream Team',
'transmission': 'manual',
'trim': 'Dream Team',
'year': 2020}
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-29 10:43:55 [auto1.de] INFO: Saving data for KW41122: {'auction_closing_time': 1774884366.0, 'created_time': 1774349955.289039, 'last_price_update_time': 1774781035.742442}
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW41122') HTTP/1.1" 204 0
2026-03-29 10:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-29 10:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798
2026-03-29 10:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a02ad922-971e-54a5-8fdc-c6567d88302d with identifier: XL82798 to the API
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:16:55Z',
'fuel_type': 'petrol',
'id': 'a02ad922-971e-54a5-8fdc-c6567d88302d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL82798',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 200178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-31',
'seller_name': None,
'title': 'Mazda 6 2.0 Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2007}
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-29 10:43:56 [auto1.de] INFO: Saving data for XL82798: {'auction_closing_time': 1774883815.0, 'created_time': 1774694113.341895, 'last_price_update_time': 1774781036.055187}
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL82798') HTTP/1.1" 204 0
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-29 10:43:56 [auto1.de] INFO: Scrape type for EU16330: 2
2026-03-29 10:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-29 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with scrape type 2
2026-03-29 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with scrape type 2
2026-03-29 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b, identifier: EU16330
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-29 10:43:56 [auto1.de] INFO: Scrape type for DE88009: 2
2026-03-29 10:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-29 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with scrape type 2
2026-03-29 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with scrape type 2
2026-03-29 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa, identifier: DE88009
2026-03-29 10:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-29 10:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330
2026-03-29 10:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b with identifier: EU16330 to the API
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:56:36Z',
'fuel_type': 'diesel',
'id': 'efc15adc-2a4f-5ab6-9b75-fae8a78e2c8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU16330',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 170520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-21',
'seller_name': None,
'title': 'Opel Astra 1.5 CDTI Start/Stop',
'transmission': 'manual',
'trim': 'Start/Stop',
'year': 2020}
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-29 10:43:56 [auto1.de] INFO: Saving data for EU16330: {'auction_closing_time': 1774886196.0, 'created_time': 1774694277.94371, 'last_price_update_time': 1774781036.57728}
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU16330') HTTP/1.1" 204 0
2026-03-29 10:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-29 10:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009
2026-03-29 10:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9be9d28-90d2-5cda-b5d8-7e02de97eaaa with identifier: DE88009 to the API
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:21:42Z',
'fuel_type': 'diesel',
'id': 'd9be9d28-90d2-5cda-b5d8-7e02de97eaaa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE88009',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 121387,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-07',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2017}
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-29 10:43:56 [auto1.de] INFO: Saving data for DE88009: {'auction_closing_time': 1774884102.0, 'created_time': 1774118823.170682, 'last_price_update_time': 1774781036.971512}
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE88009') HTTP/1.1" 204 0
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-29 10:43:56 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-29 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-29 10:43:57 [auto1.de] INFO: Scrape type for DR88922: 2
2026-03-29 10:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-29 10:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06aac50-c7fe-581f-89c7-06bc526592aa with scrape type 2
2026-03-29 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06aac50-c7fe-581f-89c7-06bc526592aa with scrape type 2
2026-03-29 10:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f06aac50-c7fe-581f-89c7-06bc526592aa, identifier: DR88922
2026-03-29 10:43:57 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-29 10:43:57 [auto1.de] INFO: Scrape type for HF51839: 2
2026-03-29 10:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-29 10:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2652391c-004d-567a-a177-39b2dc05ed5d with scrape type 2
2026-03-29 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2652391c-004d-567a-a177-39b2dc05ed5d with scrape type 2
2026-03-29 10:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2652391c-004d-567a-a177-39b2dc05ed5d, identifier: HF51839
2026-03-29 10:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-29 10:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922
2026-03-29 10:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f06aac50-c7fe-581f-89c7-06bc526592aa with identifier: DR88922 to the API
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:51:00Z',
'fuel_type': 'diesel',
'id': 'f06aac50-c7fe-581f-89c7-06bc526592aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR88922',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 216677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-15',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2013}
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-29 10:43:57 [auto1.de] INFO: Saving data for DR88922: {'auction_closing_time': 1774885860.0, 'created_time': 1774694251.403192, 'last_price_update_time': 1774781037.496072}
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR88922') HTTP/1.1" 204 0
2026-03-29 10:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-29 10:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839
2026-03-29 10:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2652391c-004d-567a-a177-39b2dc05ed5d with identifier: HF51839 to the API
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:34:57Z',
'fuel_type': 'petrol',
'id': '2652391c-004d-567a-a177-39b2dc05ed5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF51839',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 157865,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-21',
'seller_name': None,
'title': 'Opel Adam 1.4 120 Jahre',
'transmission': 'manual',
'trim': '120 Jahre',
'year': 2019}
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-29 10:43:57 [auto1.de] INFO: Saving data for HF51839: {'auction_closing_time': 1774884897.0, 'created_time': 1774694201.465885, 'last_price_update_time': 1774781037.802725}
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF51839') HTTP/1.1" 204 0
2026-03-29 10:43:57 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-29 10:43:57 [auto1.de] INFO: Scrape type for SL55745: 2
2026-03-29 10:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-29 10:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53b9138-9074-555b-b88c-a70257f8f2c4 with scrape type 2
2026-03-29 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53b9138-9074-555b-b88c-a70257f8f2c4 with scrape type 2
2026-03-29 10:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53b9138-9074-555b-b88c-a70257f8f2c4, identifier: SL55745
2026-03-29 10:43:57 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-29 10:43:57 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-29 10:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-29 10:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745
2026-03-29 10:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53b9138-9074-555b-b88c-a70257f8f2c4 with identifier: SL55745 to the API
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:49:42Z',
'fuel_type': 'petrol',
'id': 'a53b9138-9074-555b-b88c-a70257f8f2c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL55745',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon',
'odometer': 127090,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-26',
'seller_name': None,
'title': 'Volkswagen Arteon 2.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Saving data for SL55745: {'auction_closing_time': 1774885782.0, 'created_time': 1774380238.421618, 'last_price_update_time': 1774781038.281996}
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL55745') HTTP/1.1" 204 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for WA61115: 2
2026-03-29 10:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-29 10:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 564f935f-1fa8-5d14-af3c-585d82b9cefa with scrape type 2
2026-03-29 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 564f935f-1fa8-5d14-af3c-585d82b9cefa with scrape type 2
2026-03-29 10:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 564f935f-1fa8-5d14-af3c-585d82b9cefa, identifier: WA61115
2026-03-29 10:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-29 10:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115
2026-03-29 10:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 564f935f-1fa8-5d14-af3c-585d82b9cefa with identifier: WA61115 to the API
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:37:04Z',
'fuel_type': 'petrol',
'id': '564f935f-1fa8-5d14-af3c-585d82b9cefa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA61115',
'listing': 'auction',
'make': 'Daihatsu',
'model': 'Cuore',
'odometer': 14643,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-08-07',
'seller_name': None,
'title': 'Daihatsu Cuore 1.0 Top',
'transmission': 'automatic',
'trim': 'Top',
'year': 2003}
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Saving data for WA61115: {'auction_closing_time': 1774885024.0, 'created_time': 1774694128.855788, 'last_price_update_time': 1774781038.707987}
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA61115') HTTP/1.1" 204 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for SJ49235: 2
2026-03-29 10:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-29 10:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with scrape type 2
2026-03-29 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with scrape type 2
2026-03-29 10:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cdaa351-f824-5eb0-9ac3-0fbe71763305, identifier: SJ49235
2026-03-29 10:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-29 10:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235
2026-03-29 10:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cdaa351-f824-5eb0-9ac3-0fbe71763305 with identifier: SJ49235 to the API
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:10:03Z',
'fuel_type': 'petrol',
'id': '5cdaa351-f824-5eb0-9ac3-0fbe71763305',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ49235',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 151614,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-10',
'seller_name': None,
'title': 'Hyundai i20 1.4 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2010}
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Saving data for SJ49235: {'auction_closing_time': 1774883403.0, 'created_time': 1774694174.949756, 'last_price_update_time': 1774781039.139372}
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ49235') HTTP/1.1" 204 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for BT33018: 2
2026-03-29 10:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-29 10:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7fa6df-069b-5084-963f-b7b83500914f with scrape type 2
2026-03-29 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7fa6df-069b-5084-963f-b7b83500914f with scrape type 2
2026-03-29 10:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7fa6df-069b-5084-963f-b7b83500914f, identifier: BT33018
2026-03-29 10:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-29 10:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018
2026-03-29 10:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7fa6df-069b-5084-963f-b7b83500914f with identifier: BT33018 to the API
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:49:55Z',
'fuel_type': 'petrol',
'id': '9c7fa6df-069b-5084-963f-b7b83500914f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT33018',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 97913,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-10',
'seller_name': None,
'title': 'BMW 3er 320i GT Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2015}
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Saving data for BT33018: {'auction_closing_time': 1774885795.0, 'created_time': 1774694104.084189, 'last_price_update_time': 1774781039.587898}
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT33018') HTTP/1.1" 204 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for KT95165: 2
2026-03-29 10:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-29 10:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2512c744-7b0b-57cd-b201-b5465d76730b with scrape type 2
2026-03-29 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2512c744-7b0b-57cd-b201-b5465d76730b with scrape type 2
2026-03-29 10:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2512c744-7b0b-57cd-b201-b5465d76730b, identifier: KT95165
2026-03-29 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-29 10:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165
2026-03-29 10:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2512c744-7b0b-57cd-b201-b5465d76730b with identifier: KT95165 to the API
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:48:59Z',
'fuel_type': 'petrol',
'id': '2512c744-7b0b-57cd-b201-b5465d76730b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT95165',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 100288,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-28',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 150 Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Saving data for KT95165: {'auction_closing_time': 1774885739.0, 'created_time': 1774694105.035467, 'last_price_update_time': 1774781040.180872}
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT95165') HTTP/1.1" 204 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for JX65004: 2
2026-03-29 10:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-29 10:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ed1071-c499-5702-b65b-3b299dc96b2d with scrape type 2
2026-03-29 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7ed1071-c499-5702-b65b-3b299dc96b2d with scrape type 2
2026-03-29 10:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7ed1071-c499-5702-b65b-3b299dc96b2d, identifier: JX65004
2026-03-29 10:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-29 10:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004
2026-03-29 10:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7ed1071-c499-5702-b65b-3b299dc96b2d with identifier: JX65004 to the API
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:17:39Z',
'fuel_type': 'petrol',
'id': 'f7ed1071-c499-5702-b65b-3b299dc96b2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX65004',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 125671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-07',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 43 AMG 4Matic AMG',
'transmission': 'automatic',
'trim': '4Matic AMG',
'year': 2017}
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Saving data for JX65004: {'auction_closing_time': 1774883859.0, 'created_time': 1773427187.821561, 'last_price_update_time': 1774781040.610996}
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX65004') HTTP/1.1" 204 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for VG77732: 2
2026-03-29 10:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-29 10:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12179171-19be-5438-b8bc-33c1509085bf with scrape type 2
2026-03-29 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12179171-19be-5438-b8bc-33c1509085bf with scrape type 2
2026-03-29 10:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12179171-19be-5438-b8bc-33c1509085bf, identifier: VG77732
2026-03-29 10:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-29 10:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732
2026-03-29 10:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12179171-19be-5438-b8bc-33c1509085bf with identifier: VG77732 to the API
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:53:01Z',
'fuel_type': 'petrol',
'id': '12179171-19be-5438-b8bc-33c1509085bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG77732',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 81203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-15',
'seller_name': None,
'title': 'Hyundai Kona 1.0 TGDI Premium 2WD',
'transmission': 'manual',
'trim': 'Premium 2WD',
'year': 2018}
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Saving data for VG77732: {'auction_closing_time': 1774885981.0, 'created_time': 1774031735.778555, 'last_price_update_time': 1774781041.025456}
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG77732') HTTP/1.1" 204 0
2026-03-29 10:44:01 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Scrape type for MW16405: 2
2026-03-29 10:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-29 10:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with scrape type 2
2026-03-29 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with scrape type 2
2026-03-29 10:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6, identifier: MW16405
2026-03-29 10:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-29 10:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405
2026-03-29 10:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4eabf51d-c195-50eb-9294-2db4cf9f9fe6 with identifier: MW16405 to the API
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:28:57Z',
'fuel_type': 'diesel',
'id': '4eabf51d-c195-50eb-9294-2db4cf9f9fe6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW16405',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 137367,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-25',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2019}
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Saving data for MW16405: {'auction_closing_time': 1774884537.0, 'created_time': 1773468073.91769, 'last_price_update_time': 1774781041.482217}
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW16405') HTTP/1.1" 204 0
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Scrape type for FB20065: 2
2026-03-29 10:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-29 10:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with scrape type 2
2026-03-29 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with scrape type 2
2026-03-29 10:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03, identifier: FB20065
2026-03-29 10:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Scrape type for BY24352: 2
2026-03-29 10:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-29 10:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab459e5-aeb8-5306-a7da-d651b0564c61 with scrape type 2
2026-03-29 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab459e5-aeb8-5306-a7da-d651b0564c61 with scrape type 2
2026-03-29 10:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ab459e5-aeb8-5306-a7da-d651b0564c61, identifier: BY24352
2026-03-29 10:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-29 10:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065
2026-03-29 10:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e3d2333-5cf7-59d3-a06a-3e38f583ca03 with identifier: FB20065 to the API
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:41:02Z',
'fuel_type': 'petrol',
'id': '1e3d2333-5cf7-59d3-a06a-3e38f583ca03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB20065',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 58392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-02',
'seller_name': None,
'title': 'Kia Venga 1.6 FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2013}
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Saving data for FB20065: {'auction_closing_time': 1774885262.0, 'created_time': 1774694186.507469, 'last_price_update_time': 1774781041.997303}
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB20065') HTTP/1.1" 204 0
2026-03-29 10:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-29 10:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352
2026-03-29 10:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ab459e5-aeb8-5306-a7da-d651b0564c61 with identifier: BY24352 to the API
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:13:02Z',
'fuel_type': 'petrol',
'id': '7ab459e5-aeb8-5306-a7da-d651b0564c61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY24352',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 190692,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-16',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2011}
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-29 10:44:02 [auto1.de] INFO: Saving data for BY24352: {'auction_closing_time': 1774883582.0, 'created_time': 1774694101.768542, 'last_price_update_time': 1774781042.288791}
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY24352') HTTP/1.1" 204 0
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-29 10:44:02 [auto1.de] INFO: Scrape type for YV73995: 2
2026-03-29 10:44:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-29 10:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490edfac-ca32-5de2-a444-b7b49007d687 with scrape type 2
2026-03-29 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490edfac-ca32-5de2-a444-b7b49007d687 with scrape type 2
2026-03-29 10:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 490edfac-ca32-5de2-a444-b7b49007d687, identifier: YV73995
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-29 10:44:02 [auto1.de] INFO: Scrape type for SV90594: 2
2026-03-29 10:44:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-29 10:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a47f807-665f-57f6-8259-b646dbe17ecc with scrape type 2
2026-03-29 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a47f807-665f-57f6-8259-b646dbe17ecc with scrape type 2
2026-03-29 10:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a47f807-665f-57f6-8259-b646dbe17ecc, identifier: SV90594
2026-03-29 10:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-29 10:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995
2026-03-29 10:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 490edfac-ca32-5de2-a444-b7b49007d687 with identifier: YV73995 to the API
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:37:19Z',
'fuel_type': 'petrol',
'id': '490edfac-ca32-5de2-a444-b7b49007d687',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV73995',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 94429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-07',
'seller_name': None,
'title': 'Hyundai i20 1.2 YES!',
'transmission': 'manual',
'trim': 'YES!',
'year': 2019}
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-29 10:44:02 [auto1.de] INFO: Saving data for YV73995: {'auction_closing_time': 1774885039.0, 'created_time': 1774694209.611673, 'last_price_update_time': 1774781042.861549}
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV73995') HTTP/1.1" 204 0
2026-03-29 10:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-29 10:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594
2026-03-29 10:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a47f807-665f-57f6-8259-b646dbe17ecc with identifier: SV90594 to the API
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:53:32Z',
'fuel_type': 'petrol',
'id': '7a47f807-665f-57f6-8259-b646dbe17ecc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV90594',
'listing': 'auction',
'make': 'Smart',
'model': 'forfour',
'odometer': 191114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-02-24',
'seller_name': None,
'title': 'Smart forfour 1.3 Basis passion',
'transmission': 'manual',
'trim': 'Basis passion',
'year': 2005}
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Saving data for SV90594: {'auction_closing_time': 1774886012.0, 'created_time': 1774694290.604188, 'last_price_update_time': 1774781043.252241}
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV90594') HTTP/1.1" 204 0
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for JX55294: 2
2026-03-29 10:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-29 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd22b49-f425-52b7-9283-cf249c2f685b with scrape type 2
2026-03-29 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dd22b49-f425-52b7-9283-cf249c2f685b with scrape type 2
2026-03-29 10:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dd22b49-f425-52b7-9283-cf249c2f685b, identifier: JX55294
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for CN43056: 2
2026-03-29 10:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-29 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9838a0-5635-5efe-a023-88e227b78e90 with scrape type 2
2026-03-29 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9838a0-5635-5efe-a023-88e227b78e90 with scrape type 2
2026-03-29 10:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9838a0-5635-5efe-a023-88e227b78e90, identifier: CN43056
2026-03-29 10:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-29 10:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294
2026-03-29 10:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dd22b49-f425-52b7-9283-cf249c2f685b with identifier: JX55294 to the API
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:23:36Z',
'fuel_type': 'diesel',
'id': '8dd22b49-f425-52b7-9283-cf249c2f685b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX55294',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 204078,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-25',
'seller_name': None,
'title': 'BMW X1 xDrive 20d',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Saving data for JX55294: {'auction_closing_time': 1774884216.0, 'created_time': 1774694117.876477, 'last_price_update_time': 1774781043.862385}
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX55294') HTTP/1.1" 204 0
2026-03-29 10:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-29 10:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056
2026-03-29 10:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9838a0-5635-5efe-a023-88e227b78e90 with identifier: CN43056 to the API
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:51:25Z',
'fuel_type': 'petrol',
'id': 'ba9838a0-5635-5efe-a023-88e227b78e90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN43056',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 128132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-19',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Celebration',
'transmission': 'manual',
'trim': 'Celebration',
'year': 2016}
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Saving data for CN43056: {'auction_closing_time': 1774885885.0, 'created_time': 1774694262.82587, 'last_price_update_time': 1774781044.184039}
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN43056') HTTP/1.1" 204 0
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for BK93979: 2
2026-03-29 10:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-29 10:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with scrape type 2
2026-03-29 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with scrape type 2
2026-03-29 10:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e, identifier: BK93979
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for RA08562: 2
2026-03-29 10:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-29 10:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8efef272-f0e7-569f-a3f9-44308784166b with scrape type 2
2026-03-29 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8efef272-f0e7-569f-a3f9-44308784166b with scrape type 2
2026-03-29 10:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8efef272-f0e7-569f-a3f9-44308784166b, identifier: RA08562
2026-03-29 10:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-29 10:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979
2026-03-29 10:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dea8a1c-b427-57fe-bd4e-7de622ccbc4e with identifier: BK93979 to the API
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:11:08Z',
'fuel_type': 'diesel',
'id': '6dea8a1c-b427-57fe-bd4e-7de622ccbc4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK93979',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 89952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-15',
'seller_name': None,
'title': 'Citroen C4 Picasso 2.0 Blue-HDi Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2018}
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Saving data for BK93979: {'auction_closing_time': 1774883468.0, 'created_time': 1774694112.198848, 'last_price_update_time': 1774781044.805881}
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK93979') HTTP/1.1" 204 0
2026-03-29 10:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-29 10:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562
2026-03-29 10:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8efef272-f0e7-569f-a3f9-44308784166b with identifier: RA08562 to the API
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:04:34Z',
'fuel_type': 'petrol',
'id': '8efef272-f0e7-569f-a3f9-44308784166b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA08562',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 128632,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2017}
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Saving data for RA08562: {'auction_closing_time': 1774883074.0, 'created_time': 1774031664.268552, 'last_price_update_time': 1774781045.173384}
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA08562') HTTP/1.1" 204 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for LC65511: 2
2026-03-29 10:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-29 10:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with scrape type 2
2026-03-29 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with scrape type 2
2026-03-29 10:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a, identifier: LC65511
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for MZ03639: 2
2026-03-29 10:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-29 10:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afba7f48-3803-5520-a7ee-cb203868f1e3 with scrape type 2
2026-03-29 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afba7f48-3803-5520-a7ee-cb203868f1e3 with scrape type 2
2026-03-29 10:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afba7f48-3803-5520-a7ee-cb203868f1e3, identifier: MZ03639
2026-03-29 10:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-29 10:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511
2026-03-29 10:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a with identifier: LC65511 to the API
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-30T15:07:07Z',
'fuel_type': 'petrol',
'id': 'd5ec9047-b3dc-5b2d-beda-bd8cacf3cb4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC65511',
'listing': 'auction',
'make': 'Nissan',
'model': 'Murano',
'odometer': 164789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-11-16',
'seller_name': None,
'title': 'Nissan Murano 3.5 V6 Basis',
'transmission': 'automatic',
'trim': 'Basis',
'year': 2005}
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Saving data for LC65511: {'auction_closing_time': 1774883227.0, 'created_time': 1773402304.385405, 'last_price_update_time': 1774781045.699245}
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC65511') HTTP/1.1" 204 0
2026-03-29 10:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-29 10:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639
2026-03-29 10:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afba7f48-3803-5520-a7ee-cb203868f1e3 with identifier: MZ03639 to the API
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:51:35Z',
'fuel_type': 'diesel',
'id': 'afba7f48-3803-5520-a7ee-cb203868f1e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ03639',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 224587,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-17',
'seller_name': None,
'title': 'Volvo XC60 2.4D DRIVe Summum Drive',
'transmission': 'automatic',
'trim': 'Summum Drive',
'year': 2010}
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Saving data for MZ03639: {'auction_closing_time': 1774885895.0, 'created_time': 1774348962.067369, 'last_price_update_time': 1774781046.234255}
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ03639') HTTP/1.1" 204 0
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for NH74164: 2
2026-03-29 10:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-29 10:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with scrape type 2
2026-03-29 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with scrape type 2
2026-03-29 10:44:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1, identifier: NH74164
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for EL77757: 2
2026-03-29 10:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-29 10:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18c4836-9a86-536e-906e-bf9f269c6ff1 with scrape type 2
2026-03-29 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e18c4836-9a86-536e-906e-bf9f269c6ff1 with scrape type 2
2026-03-29 10:44:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e18c4836-9a86-536e-906e-bf9f269c6ff1, identifier: EL77757
2026-03-29 10:44:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-29 10:44:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164
2026-03-29 10:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1 with identifier: NH74164 to the API
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:58:58Z',
'fuel_type': 'petrol',
'id': 'c4b7d3c9-184e-55ec-bd5f-9a0062da7aa1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH74164',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 127491,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-10',
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Saving data for NH74164: {'auction_closing_time': 1774886338.0, 'created_time': 1774089330.75655, 'last_price_update_time': 1774781046.828647}
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH74164') HTTP/1.1" 204 0
2026-03-29 10:44:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-29 10:44:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757
2026-03-29 10:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e18c4836-9a86-536e-906e-bf9f269c6ff1 with identifier: EL77757 to the API
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:54:50Z',
'fuel_type': 'petrol',
'id': 'e18c4836-9a86-536e-906e-bf9f269c6ff1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL77757',
'listing': 'auction',
'make': 'Renault',
'model': 'Talisman',
'odometer': 124617,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-28',
'seller_name': None,
'title': 'Renault Talisman 1.8 TCe Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2019}
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Saving data for EL77757: {'auction_closing_time': 1774886090.0, 'created_time': 1774694370.730648, 'last_price_update_time': 1774781047.122721}
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL77757') HTTP/1.1" 204 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for CG50140: 2
2026-03-29 10:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-29 10:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121ce847-36ec-551c-b0b2-bd2524907430 with scrape type 2
2026-03-29 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 121ce847-36ec-551c-b0b2-bd2524907430 with scrape type 2
2026-03-29 10:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 121ce847-36ec-551c-b0b2-bd2524907430, identifier: CG50140
2026-03-29 10:44:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:07 [scrapy.extensions.logstats] INFO: Crawled 230 pages (at 8 pages/min), scraped 374 items (at 103 items/min)
2026-03-29 10:44:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for BS45971: 2
2026-03-29 10:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-29 10:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with scrape type 2
2026-03-29 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with scrape type 2
2026-03-29 10:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc, identifier: BS45971
2026-03-29 10:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-29 10:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140
2026-03-29 10:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 121ce847-36ec-551c-b0b2-bd2524907430 with identifier: CG50140 to the API
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:21:46Z',
'fuel_type': 'diesel',
'id': '121ce847-36ec-551c-b0b2-bd2524907430',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG50140',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 178371,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-21',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Saving data for CG50140: {'auction_closing_time': 1774884106.0, 'created_time': 1774349322.620311, 'last_price_update_time': 1774781047.716961}
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG50140') HTTP/1.1" 204 0
2026-03-29 10:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-29 10:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971
2026-03-29 10:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bf41aa3-5862-5b23-9dfa-3008f24b7ebc with identifier: BS45971 to the API
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 141,
'expiration_date': '2026-03-30T15:41:59Z',
'fuel_type': 'hybrid',
'id': '6bf41aa3-5862-5b23-9dfa-3008f24b7ebc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS45971',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 48512,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-18',
'seller_name': None,
'title': "Kia cee'd 1.6 Plug-in Hybrid Spirit",
'transmission': 'automatic',
'trim': 'Spirit',
'year': 2022}
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Saving data for BS45971: {'auction_closing_time': 1774885319.0, 'created_time': 1774118561.163237, 'last_price_update_time': 1774781048.060406}
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS45971') HTTP/1.1" 204 0
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Scrape type for YL16347: 2
2026-03-29 10:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-29 10:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77132a8e-4535-57ec-b73e-078db3aa9b09 with scrape type 2
2026-03-29 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77132a8e-4535-57ec-b73e-078db3aa9b09 with scrape type 2
2026-03-29 10:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77132a8e-4535-57ec-b73e-078db3aa9b09, identifier: YL16347
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Scrape type for NT95392: 2
2026-03-29 10:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-29 10:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e07818-2481-54ef-8dcf-68e508dccf12 with scrape type 2
2026-03-29 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e07818-2481-54ef-8dcf-68e508dccf12 with scrape type 2
2026-03-29 10:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e07818-2481-54ef-8dcf-68e508dccf12, identifier: NT95392
2026-03-29 10:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-29 10:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347
2026-03-29 10:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77132a8e-4535-57ec-b73e-078db3aa9b09 with identifier: YL16347 to the API
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:39:02Z',
'fuel_type': 'petrol',
'id': '77132a8e-4535-57ec-b73e-078db3aa9b09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL16347',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 198958,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-25',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 400 T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2017}
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Saving data for YL16347: {'auction_closing_time': 1774885142.0, 'created_time': 1774694120.426246, 'last_price_update_time': 1774781048.587179}
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL16347') HTTP/1.1" 204 0
2026-03-29 10:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-29 10:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392
2026-03-29 10:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e07818-2481-54ef-8dcf-68e508dccf12 with identifier: NT95392 to the API
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:10Z',
'fuel_type': 'petrol',
'id': 'e7e07818-2481-54ef-8dcf-68e508dccf12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT95392',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 124277,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-15',
'seller_name': None,
'title': 'Ford Focus 1.6 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Saving data for NT95392: {'auction_closing_time': 1774885690.0, 'created_time': 1774694214.796644, 'last_price_update_time': 1774781048.879331}
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT95392') HTTP/1.1" 204 0
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Scrape type for MN41763: 2
2026-03-29 10:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-29 10:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with scrape type 2
2026-03-29 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with scrape type 2
2026-03-29 10:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b46660f-5c9b-57a1-ad9b-998e17964bb4, identifier: MN41763
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-29 10:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-29 10:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763
2026-03-29 10:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b46660f-5c9b-57a1-ad9b-998e17964bb4 with identifier: MN41763 to the API
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:18:01Z',
'fuel_type': 'petrol',
'id': '3b46660f-5c9b-57a1-ad9b-998e17964bb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN41763',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 38433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-24',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 250 Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2023}
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Saving data for MN41763: {'auction_closing_time': 1774883881.0, 'created_time': 1774694149.695584, 'last_price_update_time': 1774781049.2745}
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN41763') HTTP/1.1" 204 0
2026-03-29 10:44:09 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for SY55071: 2
2026-03-29 10:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-29 10:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with scrape type 2
2026-03-29 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with scrape type 2
2026-03-29 10:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738, identifier: SY55071
2026-03-29 10:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-29 10:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071
2026-03-29 10:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dca0f26-20ff-5c8d-90cb-b2d373c3f738 with identifier: SY55071 to the API
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:23:26Z',
'fuel_type': 'diesel',
'id': '4dca0f26-20ff-5c8d-90cb-b2d373c3f738',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY55071',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 32844,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-06',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2022}
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Saving data for SY55071: {'auction_closing_time': 1774884206.0, 'created_time': 1773469025.093341, 'last_price_update_time': 1774781049.781002}
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY55071') HTTP/1.1" 204 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for SS56268: 2
2026-03-29 10:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-29 10:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with scrape type 2
2026-03-29 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with scrape type 2
2026-03-29 10:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a09f128-aacd-51ad-a7f5-c28e24a60e69, identifier: SS56268
2026-03-29 10:44:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for WT57840: 2
2026-03-29 10:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-29 10:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with scrape type 2
2026-03-29 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with scrape type 2
2026-03-29 10:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02, identifier: WT57840
2026-03-29 10:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-29 10:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268
2026-03-29 10:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a09f128-aacd-51ad-a7f5-c28e24a60e69 with identifier: SS56268 to the API
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:36:30Z',
'fuel_type': 'petrol',
'id': '1a09f128-aacd-51ad-a7f5-c28e24a60e69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS56268',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 57572,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-17',
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TSI R',
'transmission': 'manual',
'trim': 'R',
'year': 2015}
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Saving data for SS56268: {'auction_closing_time': 1774884990.0, 'created_time': 1773917339.201921, 'last_price_update_time': 1774781050.346008}
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS56268') HTTP/1.1" 204 0
2026-03-29 10:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-29 10:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840
2026-03-29 10:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e5dce97-6cd0-5aed-958f-d378e5b9ac02 with identifier: WT57840 to the API
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:25:11Z',
'fuel_type': 'petrol',
'id': '9e5dce97-6cd0-5aed-958f-d378e5b9ac02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT57840',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 78405,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.0 Diamant Edition',
'transmission': 'manual',
'trim': 'Diamant Edition',
'year': 2015}
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Saving data for WT57840: {'auction_closing_time': 1774884311.0, 'created_time': 1774694140.114666, 'last_price_update_time': 1774781050.675241}
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT57840') HTTP/1.1" 204 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for HM38388: 2
2026-03-29 10:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-29 10:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a11244-40b5-52af-90ab-6bd4f8219b42 with scrape type 2
2026-03-29 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a11244-40b5-52af-90ab-6bd4f8219b42 with scrape type 2
2026-03-29 10:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11a11244-40b5-52af-90ab-6bd4f8219b42, identifier: HM38388
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for BZ34179: 2
2026-03-29 10:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-29 10:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f445c9-22bc-57d0-ba5e-3c55a890873f with scrape type 2
2026-03-29 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2f445c9-22bc-57d0-ba5e-3c55a890873f with scrape type 2
2026-03-29 10:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2f445c9-22bc-57d0-ba5e-3c55a890873f, identifier: BZ34179
2026-03-29 10:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-29 10:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388
2026-03-29 10:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11a11244-40b5-52af-90ab-6bd4f8219b42 with identifier: HM38388 to the API
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:45:42Z',
'fuel_type': 'petrol',
'id': '11a11244-40b5-52af-90ab-6bd4f8219b42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM38388',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 86270,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-31',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2001}
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Saving data for HM38388: {'auction_closing_time': 1774885542.0, 'created_time': 1774694138.89955, 'last_price_update_time': 1774781051.220894}
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM38388') HTTP/1.1" 204 0
2026-03-29 10:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-29 10:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179
2026-03-29 10:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2f445c9-22bc-57d0-ba5e-3c55a890873f with identifier: BZ34179 to the API
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-30T15:38:30Z',
'fuel_type': 'petrol',
'id': 'f2f445c9-22bc-57d0-ba5e-3c55a890873f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ34179',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 44697,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-11',
'seller_name': None,
'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Comfort+ 4x2',
'transmission': 'manual',
'trim': 'Comfort+ 4x2',
'year': 2021}
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Saving data for BZ34179: {'auction_closing_time': 1774885110.0, 'created_time': 1774694141.399521, 'last_price_update_time': 1774781051.59348}
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ34179') HTTP/1.1" 204 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for SA98041: 2
2026-03-29 10:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-29 10:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b12379-1f78-5394-801a-e102a6b1d01b with scrape type 2
2026-03-29 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99b12379-1f78-5394-801a-e102a6b1d01b with scrape type 2
2026-03-29 10:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99b12379-1f78-5394-801a-e102a6b1d01b, identifier: SA98041
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for GZ42240: 2
2026-03-29 10:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-29 10:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6aabce2-599c-5322-956f-d3aae5c6ca07 with scrape type 2
2026-03-29 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6aabce2-599c-5322-956f-d3aae5c6ca07 with scrape type 2
2026-03-29 10:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6aabce2-599c-5322-956f-d3aae5c6ca07, identifier: GZ42240
2026-03-29 10:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-29 10:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041
2026-03-29 10:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99b12379-1f78-5394-801a-e102a6b1d01b with identifier: SA98041 to the API
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:43:42Z',
'fuel_type': 'diesel',
'id': '99b12379-1f78-5394-801a-e102a6b1d01b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA98041',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 228064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-17',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2016}
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-29 10:44:12 [auto1.de] INFO: Saving data for SA98041: {'auction_closing_time': 1774885422.0, 'created_time': 1774694150.105674, 'last_price_update_time': 1774781052.143957}
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA98041') HTTP/1.1" 204 0
2026-03-29 10:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-29 10:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240
2026-03-29 10:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6aabce2-599c-5322-956f-d3aae5c6ca07 with identifier: GZ42240 to the API
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:15:26Z',
'fuel_type': 'petrol',
'id': 'f6aabce2-599c-5322-956f-d3aae5c6ca07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ42240',
'listing': 'auction',
'make': 'MINI',
'model': 'Roadster',
'odometer': 82450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-26',
'seller_name': None,
'title': 'MINI Roadster Cooper',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-29 10:44:12 [auto1.de] INFO: Saving data for GZ42240: {'auction_closing_time': 1774883726.0, 'created_time': 1774694134.148665, 'last_price_update_time': 1774781052.606828}
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ42240') HTTP/1.1" 204 0
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-29 10:44:12 [auto1.de] INFO: Scrape type for HS55924: 2
2026-03-29 10:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-29 10:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e40d7a-1df2-509f-8967-6a59f4236ef9 with scrape type 2
2026-03-29 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5e40d7a-1df2-509f-8967-6a59f4236ef9 with scrape type 2
2026-03-29 10:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5e40d7a-1df2-509f-8967-6a59f4236ef9, identifier: HS55924
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-29 10:44:12 [auto1.de] INFO: Scrape type for DZ63249: 2
2026-03-29 10:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-29 10:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb671b87-848e-544c-b050-858a564eed61 with scrape type 2
2026-03-29 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb671b87-848e-544c-b050-858a564eed61 with scrape type 2
2026-03-29 10:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb671b87-848e-544c-b050-858a564eed61, identifier: DZ63249
2026-03-29 10:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-29 10:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924
2026-03-29 10:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5e40d7a-1df2-509f-8967-6a59f4236ef9 with identifier: HS55924 to the API
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:23:17Z',
'fuel_type': 'diesel',
'id': 'f5e40d7a-1df2-509f-8967-6a59f4236ef9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS55924',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 142610,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-16',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2011}
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-29 10:44:13 [auto1.de] INFO: Saving data for HS55924: {'auction_closing_time': 1774884197.0, 'created_time': 1774694151.662681, 'last_price_update_time': 1774781053.110647}
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS55924') HTTP/1.1" 204 0
2026-03-29 10:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-29 10:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249
2026-03-29 10:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb671b87-848e-544c-b050-858a564eed61 with identifier: DZ63249 to the API
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:59Z',
'fuel_type': 'petrol',
'id': 'cb671b87-848e-544c-b050-858a564eed61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ63249',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 148748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-08',
'seller_name': None,
'title': 'Opel Zafira 1.8 Family Plus',
'transmission': 'manual',
'trim': 'Family Plus',
'year': 2012}
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-29 10:44:13 [auto1.de] INFO: Saving data for DZ63249: {'auction_closing_time': 1774883939.0, 'created_time': 1774032831.70904, 'last_price_update_time': 1774781053.403019}
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ63249') HTTP/1.1" 204 0
2026-03-29 10:44:13 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-29 10:44:13 [auto1.de] INFO: Scrape type for RM27503: 2
2026-03-29 10:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-29 10:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccab6dd2-bfa9-575d-b391-4d8448d6049e with scrape type 2
2026-03-29 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccab6dd2-bfa9-575d-b391-4d8448d6049e with scrape type 2
2026-03-29 10:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccab6dd2-bfa9-575d-b391-4d8448d6049e, identifier: RM27503
2026-03-29 10:44:13 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-29 10:44:13 [auto1.de] INFO: Scrape type for MN76950: 2
2026-03-29 10:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-29 10:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fddfe319-a9fe-5bed-9659-b7f3e9a236cc with scrape type 2
2026-03-29 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fddfe319-a9fe-5bed-9659-b7f3e9a236cc with scrape type 2
2026-03-29 10:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fddfe319-a9fe-5bed-9659-b7f3e9a236cc, identifier: MN76950
2026-03-29 10:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-29 10:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503
2026-03-29 10:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccab6dd2-bfa9-575d-b391-4d8448d6049e with identifier: RM27503 to the API
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:07:07Z',
'fuel_type': 'diesel',
'id': 'ccab6dd2-bfa9-575d-b391-4d8448d6049e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM27503',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 287117,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-13',
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-29 10:44:13 [auto1.de] INFO: Saving data for RM27503: {'auction_closing_time': 1774883227.0, 'created_time': 1774694257.068653, 'last_price_update_time': 1774781053.90565}
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM27503') HTTP/1.1" 204 0
2026-03-29 10:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-29 10:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950
2026-03-29 10:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fddfe319-a9fe-5bed-9659-b7f3e9a236cc with identifier: MN76950 to the API
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:41:42Z',
'fuel_type': 'diesel',
'id': 'fddfe319-a9fe-5bed-9659-b7f3e9a236cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN76950',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 118990,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-30',
'seller_name': None,
'title': 'Peugeot Expert 1.5 Blue-HDi Active L2',
'transmission': 'manual',
'trim': 'Active L2',
'year': 2019}
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-29 10:44:14 [auto1.de] INFO: Saving data for MN76950: {'auction_closing_time': 1774885302.0, 'created_time': 1774350059.881302, 'last_price_update_time': 1774781054.22267}
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN76950') HTTP/1.1" 204 0
2026-03-29 10:44:14 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-29 10:44:14 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-29 10:44:14 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-29 10:44:14 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-29 10:44:14 [auto1.de] INFO: Scrape type for GB23451: 2
2026-03-29 10:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-29 10:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03fc369c-9536-51ef-a70a-bc53d0d22c2b with scrape type 2
2026-03-29 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03fc369c-9536-51ef-a70a-bc53d0d22c2b with scrape type 2
2026-03-29 10:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03fc369c-9536-51ef-a70a-bc53d0d22c2b, identifier: GB23451
2026-03-29 10:44:14 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-29 10:44:14 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-29 10:44:14 [auto1.de] INFO: Scrape type for KV46000: 2
2026-03-29 10:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-29 10:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with scrape type 2
2026-03-29 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with scrape type 2
2026-03-29 10:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e7ba12b-cf48-55f4-84ac-ba6f45290689, identifier: KV46000
2026-03-29 10:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-29 10:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451
2026-03-29 10:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03fc369c-9536-51ef-a70a-bc53d0d22c2b with identifier: GB23451 to the API
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:04:13Z',
'fuel_type': 'diesel',
'id': '03fc369c-9536-51ef-a70a-bc53d0d22c2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB23451',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 99114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-26',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2012}
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-29 10:44:14 [auto1.de] INFO: Saving data for GB23451: {'auction_closing_time': 1774883053.0, 'created_time': 1774118663.627219, 'last_price_update_time': 1774781054.741341}
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB23451') HTTP/1.1" 204 0
2026-03-29 10:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-29 10:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000
2026-03-29 10:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e7ba12b-cf48-55f4-84ac-ba6f45290689 with identifier: KV46000 to the API
2026-03-29 10:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:00:39Z',
'fuel_type': 'petrol',
'id': '4e7ba12b-cf48-55f4-84ac-ba6f45290689',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV46000',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 113534,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-02',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2014}
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-29 10:44:15 [auto1.de] INFO: Saving data for KV46000: {'auction_closing_time': 1774882839.0, 'created_time': 1774089287.363021, 'last_price_update_time': 1774781055.140907}
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV46000') HTTP/1.1" 204 0
2026-03-29 10:44:15 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-29 10:44:15 [auto1.de] INFO: Scrape type for GD85387: 2
2026-03-29 10:44:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-29 10:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d70cca7-8e41-5f63-82ab-48424c729afd with scrape type 2
2026-03-29 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d70cca7-8e41-5f63-82ab-48424c729afd with scrape type 2
2026-03-29 10:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d70cca7-8e41-5f63-82ab-48424c729afd, identifier: GD85387
2026-03-29 10:44:15 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-29 10:44:15 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-29 10:44:15 [auto1.de] INFO: Scrape type for TA12646: 2
2026-03-29 10:44:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-29 10:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with scrape type 2
2026-03-29 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with scrape type 2
2026-03-29 10:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff, identifier: TA12646
2026-03-29 10:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-29 10:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387
2026-03-29 10:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d70cca7-8e41-5f63-82ab-48424c729afd with identifier: GD85387 to the API
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:42:57Z',
'fuel_type': 'petrol',
'id': '2d70cca7-8e41-5f63-82ab-48424c729afd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD85387',
'listing': 'auction',
'make': 'Infiniti',
'model': 'QX70',
'odometer': 105983,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-03',
'seller_name': None,
'title': 'Infiniti QX70 3.7 V6 S',
'transmission': 'automatic',
'trim': 'S',
'year': 2016}
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-29 10:44:15 [auto1.de] INFO: Saving data for GD85387: {'auction_closing_time': 1774885377.0, 'created_time': 1774032896.056415, 'last_price_update_time': 1774781055.672547}
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD85387') HTTP/1.1" 204 0
2026-03-29 10:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-29 10:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646
2026-03-29 10:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47d593f1-d7b4-51d7-8bd1-7d59eff12fff with identifier: TA12646 to the API
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 510,
'expiration_date': '2026-03-30T15:32:41Z',
'fuel_type': 'petrol',
'id': '47d593f1-d7b4-51d7-8bd1-7d59eff12fff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA12646',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 165255,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-25',
'seller_name': None,
'title': 'BMW 4er M4 xDrive Competition',
'transmission': 'automatic',
'trim': 'xDrive Competition',
'year': 2022}
2026-03-29 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-29 10:44:16 [auto1.de] INFO: Saving data for TA12646: {'auction_closing_time': 1774884761.0, 'created_time': 1773301374.097241, 'last_price_update_time': 1774781056.008219}
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA12646') HTTP/1.1" 204 0
2026-03-29 10:44:16 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-29 10:44:16 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-29 10:44:16 [auto1.de] INFO: Scrape type for NW01608: 2
2026-03-29 10:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-29 10:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with scrape type 2
2026-03-29 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with scrape type 2
2026-03-29 10:44:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff, identifier: NW01608
2026-03-29 10:44:16 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-29 10:44:16 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-29 10:44:16 [auto1.de] INFO: Scrape type for VG58612: 2
2026-03-29 10:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-29 10:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with scrape type 2
2026-03-29 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with scrape type 2
2026-03-29 10:44:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c, identifier: VG58612
2026-03-29 10:44:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-29 10:44:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608
2026-03-29 10:44:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34fbe7c2-cfbe-51fe-ad8f-b648660b13ff with identifier: NW01608 to the API
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:20:46Z',
'fuel_type': 'diesel',
'id': '34fbe7c2-cfbe-51fe-ad8f-b648660b13ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW01608',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 77001,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-15',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2020}
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-29 10:44:16 [auto1.de] INFO: Saving data for NW01608: {'auction_closing_time': 1774884046.0, 'created_time': 1774034112.135944, 'last_price_update_time': 1774781056.700452}
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW01608') HTTP/1.1" 204 0
2026-03-29 10:44:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-29 10:44:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612
2026-03-29 10:44:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a19348c-d2db-58bd-a3fb-68f2cbd7d55c with identifier: VG58612 to the API
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:41Z',
'fuel_type': 'diesel',
'id': '1a19348c-d2db-58bd-a3fb-68f2cbd7d55c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG58612',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 187854,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-31',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Premium Edition',
'transmission': 'automatic',
'trim': 'Premium Edition',
'year': 2018}
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-29 10:44:17 [auto1.de] INFO: Saving data for VG58612: {'auction_closing_time': 1774885301.0, 'created_time': 1774694136.238401, 'last_price_update_time': 1774781057.040323}
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG58612') HTTP/1.1" 204 0
2026-03-29 10:44:17 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-29 10:44:17 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-29 10:44:17 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-29 10:44:17 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-29 10:44:17 [auto1.de] INFO: Scrape type for TY06085: 2
2026-03-29 10:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-29 10:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce86a12-6770-5592-a386-5a5a62d50f10 with scrape type 2
2026-03-29 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bce86a12-6770-5592-a386-5a5a62d50f10 with scrape type 2
2026-03-29 10:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bce86a12-6770-5592-a386-5a5a62d50f10, identifier: TY06085
2026-03-29 10:44:17 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-29 10:44:17 [auto1.de] INFO: Scrape type for LB45550: 2
2026-03-29 10:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-29 10:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cef1c38-31d0-5cac-90d6-b1af3864eddb with scrape type 2
2026-03-29 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cef1c38-31d0-5cac-90d6-b1af3864eddb with scrape type 2
2026-03-29 10:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cef1c38-31d0-5cac-90d6-b1af3864eddb, identifier: LB45550
2026-03-29 10:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-29 10:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085
2026-03-29 10:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bce86a12-6770-5592-a386-5a5a62d50f10 with identifier: TY06085 to the API
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:44:19Z',
'fuel_type': 'petrol',
'id': 'bce86a12-6770-5592-a386-5a5a62d50f10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY06085',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 54764,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-09',
'seller_name': None,
'title': 'Suzuki Swift 1.3 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2010}
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-29 10:44:17 [auto1.de] INFO: Saving data for TY06085: {'auction_closing_time': 1774885459.0, 'created_time': 1774694142.275416, 'last_price_update_time': 1774781057.649376}
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY06085') HTTP/1.1" 204 0
2026-03-29 10:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-29 10:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550
2026-03-29 10:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cef1c38-31d0-5cac-90d6-b1af3864eddb with identifier: LB45550 to the API
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 121,
'expiration_date': '2026-03-30T15:02:34Z',
'fuel_type': 'petrol',
'id': '6cef1c38-31d0-5cac-90d6-b1af3864eddb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB45550',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 153567,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-20',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Skyactiv-G Prime-Line',
'transmission': 'manual',
'trim': 'Prime-Line',
'year': 2019}
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-29 10:44:18 [auto1.de] INFO: Saving data for LB45550: {'auction_closing_time': 1774882954.0, 'created_time': 1774694130.866996, 'last_price_update_time': 1774781058.058736}
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB45550') HTTP/1.1" 204 0
2026-03-29 10:44:18 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-29 10:44:18 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-29 10:44:18 [auto1.de] INFO: Scrape type for NU23342: 2
2026-03-29 10:44:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-29 10:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with scrape type 2
2026-03-29 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with scrape type 2
2026-03-29 10:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8, identifier: NU23342
2026-03-29 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:18 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-29 10:44:18 [auto1.de] INFO: Scrape type for YC71395: 2
2026-03-29 10:44:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-29 10:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f42f13-401c-5f80-923b-2eb45551dce0 with scrape type 2
2026-03-29 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f42f13-401c-5f80-923b-2eb45551dce0 with scrape type 2
2026-03-29 10:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f42f13-401c-5f80-923b-2eb45551dce0, identifier: YC71395
2026-03-29 10:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-29 10:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342
2026-03-29 10:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8 with identifier: NU23342 to the API
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:19:45Z',
'fuel_type': 'petrol',
'id': '97ebe5d1-3795-5bb1-9dd3-2abbf882c1e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU23342',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 150914,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-17',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2014}
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-29 10:44:18 [auto1.de] INFO: Saving data for NU23342: {'auction_closing_time': 1774883985.0, 'created_time': 1774694171.335417, 'last_price_update_time': 1774781058.593808}
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU23342') HTTP/1.1" 204 0
2026-03-29 10:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-29 10:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395
2026-03-29 10:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f42f13-401c-5f80-923b-2eb45551dce0 with identifier: YC71395 to the API
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:58:43Z',
'fuel_type': 'diesel',
'id': 'c5f42f13-401c-5f80-923b-2eb45551dce0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC71395',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 69107,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-07',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2018}
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-29 10:44:18 [auto1.de] INFO: Saving data for YC71395: {'auction_closing_time': 1774886323.0, 'created_time': 1773466897.330164, 'last_price_update_time': 1774781058.896221}
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC71395') HTTP/1.1" 204 0
2026-03-29 10:44:18 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-29 10:44:18 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-29 10:44:18 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-29 10:44:18 [auto1.de] INFO: Scrape type for FL62048: 2
2026-03-29 10:44:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-29 10:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3017df4-9d20-5512-8803-bf32bd7385e5 with scrape type 2
2026-03-29 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3017df4-9d20-5512-8803-bf32bd7385e5 with scrape type 2
2026-03-29 10:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3017df4-9d20-5512-8803-bf32bd7385e5, identifier: FL62048
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-29 10:44:19 [auto1.de] INFO: Scrape type for SW39146: 2
2026-03-29 10:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-29 10:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944e7e6f-0b17-54ff-baea-49d4542c53ef with scrape type 2
2026-03-29 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 944e7e6f-0b17-54ff-baea-49d4542c53ef with scrape type 2
2026-03-29 10:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 944e7e6f-0b17-54ff-baea-49d4542c53ef, identifier: SW39146
2026-03-29 10:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-29 10:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048
2026-03-29 10:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3017df4-9d20-5512-8803-bf32bd7385e5 with identifier: FL62048 to the API
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:35:36Z',
'fuel_type': 'diesel',
'id': 'c3017df4-9d20-5512-8803-bf32bd7385e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL62048',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 180722,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2016}
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-29 10:44:19 [auto1.de] INFO: Saving data for FL62048: {'auction_closing_time': 1774884936.0, 'created_time': 1774694161.274836, 'last_price_update_time': 1774781059.426958}
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL62048') HTTP/1.1" 204 0
2026-03-29 10:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-29 10:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146
2026-03-29 10:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 944e7e6f-0b17-54ff-baea-49d4542c53ef with identifier: SW39146 to the API
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:48:03Z',
'fuel_type': 'petrol',
'id': '944e7e6f-0b17-54ff-baea-49d4542c53ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW39146',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 76252,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-26',
'seller_name': None,
'title': 'Jaguar XF 30t Sport AWD',
'transmission': 'automatic',
'trim': 'Sport AWD',
'year': 2019}
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-29 10:44:19 [auto1.de] INFO: Saving data for SW39146: {'auction_closing_time': 1774885683.0, 'created_time': 1774349373.682184, 'last_price_update_time': 1774781059.742189}
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW39146') HTTP/1.1" 204 0
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-29 10:44:19 [auto1.de] INFO: Scrape type for MG84960: 2
2026-03-29 10:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-29 10:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f with scrape type 2
2026-03-29 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b5d5e9-a987-5298-a878-bcf8433f2a7f with scrape type 2
2026-03-29 10:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46b5d5e9-a987-5298-a878-bcf8433f2a7f, identifier: MG84960
2026-03-29 10:44:19 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:19 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-29 10:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-29 10:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960
2026-03-29 10:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46b5d5e9-a987-5298-a878-bcf8433f2a7f with identifier: MG84960 to the API
2026-03-29 10:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:00:52Z',
'fuel_type': 'petrol',
'id': '46b5d5e9-a987-5298-a878-bcf8433f2a7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG84960',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 188478,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-23',
'seller_name': None,
'title': 'Dacia Lodgy 1.6 SCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2019}
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-29 10:44:20 [auto1.de] INFO: Saving data for MG84960: {'auction_closing_time': 1774882852.0, 'created_time': 1774694176.205294, 'last_price_update_time': 1774781060.153779}
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG84960') HTTP/1.1" 204 0
2026-03-29 10:44:20 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-29 10:44:20 [auto1.de] INFO: Scrape type for KU56806: 2
2026-03-29 10:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-29 10:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea86f3eb-85a4-59f1-8270-431e62fee293 with scrape type 2
2026-03-29 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea86f3eb-85a4-59f1-8270-431e62fee293 with scrape type 2
2026-03-29 10:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea86f3eb-85a4-59f1-8270-431e62fee293, identifier: KU56806
2026-03-29 10:44:20 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-29 10:44:20 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-29 10:44:20 [auto1.de] INFO: Scrape type for SB90605: 2
2026-03-29 10:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-29 10:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with scrape type 2
2026-03-29 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with scrape type 2
2026-03-29 10:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85733017-482c-5aa5-ae3d-39c5cf1e9b63, identifier: SB90605
2026-03-29 10:44:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-29 10:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806
2026-03-29 10:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea86f3eb-85a4-59f1-8270-431e62fee293 with identifier: KU56806 to the API
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:30:08Z',
'fuel_type': 'petrol',
'id': 'ea86f3eb-85a4-59f1-8270-431e62fee293',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU56806',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 109022,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-27',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2010}
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-29 10:44:20 [auto1.de] INFO: Saving data for KU56806: {'auction_closing_time': 1774884608.0, 'created_time': 1774118750.988484, 'last_price_update_time': 1774781060.810187}
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU56806') HTTP/1.1" 204 0
2026-03-29 10:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-29 10:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605
2026-03-29 10:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85733017-482c-5aa5-ae3d-39c5cf1e9b63 with identifier: SB90605 to the API
2026-03-29 10:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:47Z',
'fuel_type': 'diesel',
'id': '85733017-482c-5aa5-ae3d-39c5cf1e9b63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB90605',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 166319,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-11',
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Saving data for SB90605: {'auction_closing_time': 1774885127.0, 'created_time': 1774033101.170897, 'last_price_update_time': 1774781061.179533}
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB90605') HTTP/1.1" 204 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for YB04799: 2
2026-03-29 10:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-29 10:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with scrape type 2
2026-03-29 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with scrape type 2
2026-03-29 10:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514, identifier: YB04799
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for HL93382: 2
2026-03-29 10:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-29 10:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae973c76-46f9-5fa2-8d82-64faa3b77acd with scrape type 2
2026-03-29 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae973c76-46f9-5fa2-8d82-64faa3b77acd with scrape type 2
2026-03-29 10:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae973c76-46f9-5fa2-8d82-64faa3b77acd, identifier: HL93382
2026-03-29 10:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-29 10:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799
2026-03-29 10:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bfdcd9d-0e4d-545c-b615-fc40c3d53514 with identifier: YB04799 to the API
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:49:44Z',
'fuel_type': 'petrol',
'id': '6bfdcd9d-0e4d-545c-b615-fc40c3d53514',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB04799',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 58474,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-05',
'seller_name': None,
'title': 'Toyota Aygo 1.0 Connect',
'transmission': 'manual',
'trim': 'Connect',
'year': 2012}
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Saving data for YB04799: {'auction_closing_time': 1774885784.0, 'created_time': 1774694198.880254, 'last_price_update_time': 1774781061.743534}
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB04799') HTTP/1.1" 204 0
2026-03-29 10:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-29 10:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382
2026-03-29 10:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae973c76-46f9-5fa2-8d82-64faa3b77acd with identifier: HL93382 to the API
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:25:52Z',
'fuel_type': 'petrol',
'id': 'ae973c76-46f9-5fa2-8d82-64faa3b77acd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL93382',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 32375,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-07',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2024}
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Saving data for HL93382: {'auction_closing_time': 1774884352.0, 'created_time': 1774694154.259702, 'last_price_update_time': 1774781062.051852}
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL93382') HTTP/1.1" 204 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for ME28341: 2
2026-03-29 10:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-29 10:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09db8b05-6129-57da-a056-0a494dafc844 with scrape type 2
2026-03-29 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09db8b05-6129-57da-a056-0a494dafc844 with scrape type 2
2026-03-29 10:44:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09db8b05-6129-57da-a056-0a494dafc844, identifier: ME28341
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for HU71027: 2
2026-03-29 10:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-29 10:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b13b881e-706a-5c25-9dd9-c4635d4fbfda with scrape type 2
2026-03-29 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b13b881e-706a-5c25-9dd9-c4635d4fbfda with scrape type 2
2026-03-29 10:44:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b13b881e-706a-5c25-9dd9-c4635d4fbfda, identifier: HU71027
2026-03-29 10:44:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-29 10:44:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341
2026-03-29 10:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09db8b05-6129-57da-a056-0a494dafc844 with identifier: ME28341 to the API
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:29:26Z',
'fuel_type': 'petrol',
'id': '09db8b05-6129-57da-a056-0a494dafc844',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME28341',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 69902,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-10',
'seller_name': None,
'title': 'Skoda Fabia 1.0 MPI Joy',
'transmission': 'manual',
'trim': 'Joy',
'year': 2016}
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Saving data for ME28341: {'auction_closing_time': 1774884566.0, 'created_time': 1774694147.021136, 'last_price_update_time': 1774781062.62503}
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME28341') HTTP/1.1" 204 0
2026-03-29 10:44:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-29 10:44:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027
2026-03-29 10:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b13b881e-706a-5c25-9dd9-c4635d4fbfda with identifier: HU71027 to the API
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:58:02Z',
'fuel_type': 'petrol',
'id': 'b13b881e-706a-5c25-9dd9-c4635d4fbfda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU71027',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 144412,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-17',
'seller_name': None,
'title': 'Kia Picanto 1.1 EX',
'transmission': 'manual',
'trim': 'EX',
'year': 2006}
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Saving data for HU71027: {'auction_closing_time': 1774886282.0, 'created_time': 1774694167.32364, 'last_price_update_time': 1774781062.923504}
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU71027') HTTP/1.1" 204 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for AU10222: 2
2026-03-29 10:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-29 10:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be300ce-81a4-5545-899e-f30d43da3bbe with scrape type 2
2026-03-29 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be300ce-81a4-5545-899e-f30d43da3bbe with scrape type 2
2026-03-29 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5be300ce-81a4-5545-899e-f30d43da3bbe, identifier: AU10222
2026-03-29 10:44:23 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-29 10:44:23 [auto1.de] INFO: Scrape type for HW93754: 2
2026-03-29 10:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-29 10:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb8f772c-f708-53ca-a348-a48fc7e49114 with scrape type 2
2026-03-29 10:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb8f772c-f708-53ca-a348-a48fc7e49114 with scrape type 2
2026-03-29 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb8f772c-f708-53ca-a348-a48fc7e49114, identifier: HW93754
2026-03-29 10:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-29 10:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222
2026-03-29 10:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5be300ce-81a4-5545-899e-f30d43da3bbe with identifier: AU10222 to the API
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:37Z',
'fuel_type': 'diesel',
'id': '5be300ce-81a4-5545-899e-f30d43da3bbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU10222',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 131251,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-11',
'seller_name': None,
'title': 'BMW 2er 218d Gran Tourer M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-29 10:44:23 [auto1.de] INFO: Saving data for AU10222: {'auction_closing_time': 1774883197.0, 'created_time': 1774032207.91939, 'last_price_update_time': 1774781063.438397}
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU10222') HTTP/1.1" 204 0
2026-03-29 10:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-29 10:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754
2026-03-29 10:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb8f772c-f708-53ca-a348-a48fc7e49114 with identifier: HW93754 to the API
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-30T15:58:01Z',
'fuel_type': 'petrol',
'id': 'fb8f772c-f708-53ca-a348-a48fc7e49114',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW93754',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 21109,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-01',
'seller_name': None,
'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Club 4x2',
'transmission': 'manual',
'trim': 'Club 4x2',
'year': 2023}
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-29 10:44:23 [auto1.de] INFO: Saving data for HW93754: {'auction_closing_time': 1774886281.0, 'created_time': 1773467875.638911, 'last_price_update_time': 1774781063.816456}
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW93754') HTTP/1.1" 204 0
2026-03-29 10:44:23 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-29 10:44:23 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-29 10:44:23 [auto1.de] INFO: Scrape type for MN75028: 2
2026-03-29 10:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-29 10:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with scrape type 2
2026-03-29 10:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with scrape type 2
2026-03-29 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8580c2f3-7247-5588-abc8-9f5343fdb2e4, identifier: MN75028
2026-03-29 10:44:23 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-29 10:44:23 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-29 10:44:23 [auto1.de] INFO: Scrape type for NB68023: 2
2026-03-29 10:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-29 10:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67f1478-1ed0-5810-9654-25dc38d68803 with scrape type 2
2026-03-29 10:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67f1478-1ed0-5810-9654-25dc38d68803 with scrape type 2
2026-03-29 10:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d67f1478-1ed0-5810-9654-25dc38d68803, identifier: NB68023
2026-03-29 10:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-29 10:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028
2026-03-29 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8580c2f3-7247-5588-abc8-9f5343fdb2e4 with identifier: MN75028 to the API
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:07:30Z',
'fuel_type': 'diesel',
'id': '8580c2f3-7247-5588-abc8-9f5343fdb2e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN75028',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 301680,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-07',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2016}
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-29 10:44:24 [auto1.de] INFO: Saving data for MN75028: {'auction_closing_time': 1774883250.0, 'created_time': 1774694173.488493, 'last_price_update_time': 1774781064.346871}
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN75028') HTTP/1.1" 204 0
2026-03-29 10:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-29 10:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023
2026-03-29 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d67f1478-1ed0-5810-9654-25dc38d68803 with identifier: NB68023 to the API
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:05:27Z',
'fuel_type': 'diesel',
'id': 'd67f1478-1ed0-5810-9654-25dc38d68803',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB68023',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 172423,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-26',
'seller_name': None,
'title': 'Volvo V40 2.0 D2 Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2016}
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-29 10:44:24 [auto1.de] INFO: Saving data for NB68023: {'auction_closing_time': 1774883127.0, 'created_time': 1773466604.492659, 'last_price_update_time': 1774781064.653776}
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB68023') HTTP/1.1" 204 0
2026-03-29 10:44:24 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-29 10:44:24 [auto1.de] INFO: Scrape type for BG93361: 2
2026-03-29 10:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-29 10:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581f6631-be25-53cb-875a-77c2e6deaf86 with scrape type 2
2026-03-29 10:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 581f6631-be25-53cb-875a-77c2e6deaf86 with scrape type 2
2026-03-29 10:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 581f6631-be25-53cb-875a-77c2e6deaf86, identifier: BG93361
2026-03-29 10:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-29 10:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361
2026-03-29 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 581f6631-be25-53cb-875a-77c2e6deaf86 with identifier: BG93361 to the API
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:15:51Z',
'fuel_type': 'petrol',
'id': '581f6631-be25-53cb-875a-77c2e6deaf86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG93361',
'listing': 'auction',
'make': 'Toyota',
'model': 'Verso',
'odometer': 245520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-20',
'seller_name': None,
'title': 'Toyota Verso 1.8 Travel',
'transmission': 'manual',
'trim': 'Travel',
'year': 2012}
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-29 10:44:25 [auto1.de] INFO: Saving data for BG93361: {'auction_closing_time': 1774883751.0, 'created_time': 1773468278.96402, 'last_price_update_time': 1774781065.057117}
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG93361') HTTP/1.1" 204 0
2026-03-29 10:44:25 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-29 10:44:25 [auto1.de] INFO: Scrape type for ZV32018: 2
2026-03-29 10:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-29 10:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with scrape type 2
2026-03-29 10:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with scrape type 2
2026-03-29 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e8876c3-b03f-5eee-bed9-a39d915b9f60, identifier: ZV32018
2026-03-29 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-29 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018
2026-03-29 10:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e8876c3-b03f-5eee-bed9-a39d915b9f60 with identifier: ZV32018 to the API
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:39:43Z',
'fuel_type': 'petrol',
'id': '7e8876c3-b03f-5eee-bed9-a39d915b9f60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV32018',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 112053,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-24',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost SYNC Edition',
'transmission': 'manual',
'trim': 'SYNC Edition',
'year': 2013}
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-29 10:44:25 [auto1.de] INFO: Saving data for ZV32018: {'auction_closing_time': 1774885183.0, 'created_time': 1774694152.40019, 'last_price_update_time': 1774781065.447653}
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV32018') HTTP/1.1" 204 0
2026-03-29 10:44:25 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-29 10:44:25 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-29 10:44:25 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-29 10:44:25 [auto1.de] INFO: Scrape type for FT64289: 2
2026-03-29 10:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-29 10:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133c4d7c-6612-550f-b57f-bdafea4b7b9a with scrape type 2
2026-03-29 10:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 133c4d7c-6612-550f-b57f-bdafea4b7b9a with scrape type 2
2026-03-29 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 133c4d7c-6612-550f-b57f-bdafea4b7b9a, identifier: FT64289
2026-03-29 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-29 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289
2026-03-29 10:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 133c4d7c-6612-550f-b57f-bdafea4b7b9a with identifier: FT64289 to the API
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:21:50Z',
'fuel_type': 'diesel',
'id': '133c4d7c-6612-550f-b57f-bdafea4b7b9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT64289',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 8,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-06-01',
'seller_name': None,
'title': 'Renault Master 2.0 BLUE dCi 3,5t L2H2 Advance',
'transmission': 'manual',
'trim': '3,5t L2H2 Advance',
'year': 2025}
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-29 10:44:25 [auto1.de] INFO: Saving data for FT64289: {'auction_closing_time': 1774884110.0, 'created_time': 1773467046.002436, 'last_price_update_time': 1774781065.86516}
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT64289') HTTP/1.1" 204 0
2026-03-29 10:44:25 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-29 10:44:25 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-29 10:44:25 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-29 10:44:25 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-29 10:44:25 [auto1.de] INFO: Scrape type for KE10146: 2
2026-03-29 10:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-29 10:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc611779-2aff-5dfd-8d68-92ca6cef7719 with scrape type 2
2026-03-29 10:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc611779-2aff-5dfd-8d68-92ca6cef7719 with scrape type 2
2026-03-29 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc611779-2aff-5dfd-8d68-92ca6cef7719, identifier: KE10146
2026-03-29 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-29 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146
2026-03-29 10:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc611779-2aff-5dfd-8d68-92ca6cef7719 with identifier: KE10146 to the API
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:11:52Z',
'fuel_type': 'diesel',
'id': 'cc611779-2aff-5dfd-8d68-92ca6cef7719',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE10146',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 221882,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-22',
'seller_name': None,
'title': 'BMW X3 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-29 10:44:26 [auto1.de] INFO: Saving data for KE10146: {'auction_closing_time': 1774883512.0, 'created_time': 1774694274.607095, 'last_price_update_time': 1774781066.262537}
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE10146') HTTP/1.1" 204 0
2026-03-29 10:44:26 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-29 10:44:26 [auto1.de] INFO: Scrape type for PN64243: 2
2026-03-29 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-29 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8bed2b0-5856-501f-b6bc-30ea04bf2272 with scrape type 2
2026-03-29 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8bed2b0-5856-501f-b6bc-30ea04bf2272 with scrape type 2
2026-03-29 10:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8bed2b0-5856-501f-b6bc-30ea04bf2272, identifier: PN64243
2026-03-29 10:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-29 10:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243
2026-03-29 10:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8bed2b0-5856-501f-b6bc-30ea04bf2272 with identifier: PN64243 to the API
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:41:24Z',
'fuel_type': 'petrol',
'id': 'e8bed2b0-5856-501f-b6bc-30ea04bf2272',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN64243',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 218792,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-29',
'seller_name': None,
'title': 'Renault Kangoo 1.2 Campus',
'transmission': 'manual',
'trim': 'Campus',
'year': 2009}
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-29 10:44:26 [auto1.de] INFO: Saving data for PN64243: {'auction_closing_time': 1774885284.0, 'created_time': 1774089097.285585, 'last_price_update_time': 1774781066.747417}
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN64243') HTTP/1.1" 204 0
2026-03-29 10:44:26 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-29 10:44:26 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-29 10:44:26 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-29 10:44:26 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-29 10:44:26 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-29 10:44:26 [auto1.de] INFO: Scrape type for WH57282: 2
2026-03-29 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-29 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c6d5400-8ffa-525e-953f-58735e846c52 with scrape type 2
2026-03-29 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c6d5400-8ffa-525e-953f-58735e846c52 with scrape type 2
2026-03-29 10:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c6d5400-8ffa-525e-953f-58735e846c52, identifier: WH57282
2026-03-29 10:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-29 10:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282
2026-03-29 10:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c6d5400-8ffa-525e-953f-58735e846c52 with identifier: WH57282 to the API
2026-03-29 10:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:23:19Z',
'fuel_type': 'petrol',
'id': '9c6d5400-8ffa-525e-953f-58735e846c52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH57282',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 146602,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-30',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-29 10:44:27 [auto1.de] INFO: Saving data for WH57282: {'auction_closing_time': 1774884199.0, 'created_time': 1774694183.405419, 'last_price_update_time': 1774781067.142033}
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH57282') HTTP/1.1" 204 0
2026-03-29 10:44:27 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-29 10:44:27 [auto1.de] INFO: Scrape type for SE82228: 2
2026-03-29 10:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-29 10:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cc868c2-c105-5ea4-a934-cbac36b80516 with scrape type 2
2026-03-29 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cc868c2-c105-5ea4-a934-cbac36b80516 with scrape type 2
2026-03-29 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cc868c2-c105-5ea4-a934-cbac36b80516, identifier: SE82228
2026-03-29 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-29 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228
2026-03-29 10:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cc868c2-c105-5ea4-a934-cbac36b80516 with identifier: SE82228 to the API
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:38:12Z',
'fuel_type': 'diesel',
'id': '5cc868c2-c105-5ea4-a934-cbac36b80516',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE82228',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 65519,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-02',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-29 10:44:27 [auto1.de] INFO: Saving data for SE82228: {'auction_closing_time': 1774885092.0, 'created_time': 1774349193.371459, 'last_price_update_time': 1774781067.577687}
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE82228') HTTP/1.1" 204 0
2026-03-29 10:44:27 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-29 10:44:27 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-29 10:44:27 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-29 10:44:27 [auto1.de] INFO: Scrape type for ZY49257: 2
2026-03-29 10:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-29 10:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8da9ac80-f1fa-5145-ac58-89a6e14d239a with scrape type 2
2026-03-29 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8da9ac80-f1fa-5145-ac58-89a6e14d239a with scrape type 2
2026-03-29 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8da9ac80-f1fa-5145-ac58-89a6e14d239a, identifier: ZY49257
2026-03-29 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-29 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257
2026-03-29 10:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8da9ac80-f1fa-5145-ac58-89a6e14d239a with identifier: ZY49257 to the API
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:47Z',
'fuel_type': 'diesel',
'id': '8da9ac80-f1fa-5145-ac58-89a6e14d239a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY49257',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 96249,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-28',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L2H2 HKa 3,5 Komfort',
'transmission': 'manual',
'trim': 'L2H2 HKa 3,5 Komfort',
'year': 2021}
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-29 10:44:28 [auto1.de] INFO: Saving data for ZY49257: {'auction_closing_time': 1774883447.0, 'created_time': 1774264944.585885, 'last_price_update_time': 1774781068.018531}
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY49257') HTTP/1.1" 204 0
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-29 10:44:28 [auto1.de] INFO: Scrape type for PG18082: 2
2026-03-29 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-29 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85aeb97-4f94-58f2-afca-03f8884b1246 with scrape type 2
2026-03-29 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c85aeb97-4f94-58f2-afca-03f8884b1246 with scrape type 2
2026-03-29 10:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c85aeb97-4f94-58f2-afca-03f8884b1246, identifier: PG18082
2026-03-29 10:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-29 10:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082
2026-03-29 10:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c85aeb97-4f94-58f2-afca-03f8884b1246 with identifier: PG18082 to the API
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:28:09Z',
'fuel_type': 'petrol',
'id': 'c85aeb97-4f94-58f2-afca-03f8884b1246',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG18082',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 67980,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-27',
'seller_name': None,
'title': 'Audi Q2 30 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-29 10:44:28 [auto1.de] INFO: Saving data for PG18082: {'auction_closing_time': 1774884489.0, 'created_time': 1774694240.258648, 'last_price_update_time': 1774781068.399801}
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG18082') HTTP/1.1" 204 0
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-29 10:44:28 [auto1.de] INFO: Scrape type for VX47645: 2
2026-03-29 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-29 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with scrape type 2
2026-03-29 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with scrape type 2
2026-03-29 10:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1, identifier: VX47645
2026-03-29 10:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-29 10:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645
2026-03-29 10:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50b043e3-eff0-5c44-9e2d-b8220ee2e8a1 with identifier: VX47645 to the API
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:43:20Z',
'fuel_type': 'diesel',
'id': '50b043e3-eff0-5c44-9e2d-b8220ee2e8a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX47645',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 238616,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seller_name': None,
'title': 'BMW 3er 335d GT xDrive Sport Line',
'transmission': 'automatic',
'trim': 'xDrive Sport Line',
'year': 2016}
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-29 10:44:28 [auto1.de] INFO: Saving data for VX47645: {'auction_closing_time': 1774885400.0, 'created_time': 1773427825.237389, 'last_price_update_time': 1774781068.894419}
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX47645') HTTP/1.1" 204 0
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-29 10:44:28 [auto1.de] INFO: Scrape type for BV18863: 2
2026-03-29 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-29 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d09f1125-44f3-53de-baeb-61e66018ac27 with scrape type 2
2026-03-29 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d09f1125-44f3-53de-baeb-61e66018ac27 with scrape type 2
2026-03-29 10:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d09f1125-44f3-53de-baeb-61e66018ac27, identifier: BV18863
2026-03-29 10:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-29 10:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863
2026-03-29 10:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d09f1125-44f3-53de-baeb-61e66018ac27 with identifier: BV18863 to the API
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:03:39Z',
'fuel_type': 'diesel',
'id': 'd09f1125-44f3-53de-baeb-61e66018ac27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV18863',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 248236,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-02',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2012}
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Saving data for BV18863: {'auction_closing_time': 1774883019.0, 'created_time': 1774032587.235567, 'last_price_update_time': 1774781069.347001}
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV18863') HTTP/1.1" 204 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for HE38410: 2
2026-03-29 10:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-29 10:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287198ac-be94-5668-9861-a1b1a2c835af with scrape type 2
2026-03-29 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 287198ac-be94-5668-9861-a1b1a2c835af with scrape type 2
2026-03-29 10:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 287198ac-be94-5668-9861-a1b1a2c835af, identifier: HE38410
2026-03-29 10:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-29 10:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410
2026-03-29 10:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 287198ac-be94-5668-9861-a1b1a2c835af with identifier: HE38410 to the API
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:46:12Z',
'fuel_type': 'petrol',
'id': '287198ac-be94-5668-9861-a1b1a2c835af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE38410',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 125595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-15',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
'transmission': 'manual',
'trim': 'Innovation Start/Stop',
'year': 2017}
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Saving data for HE38410: {'auction_closing_time': 1774885572.0, 'created_time': 1774694187.809622, 'last_price_update_time': 1774781069.784067}
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE38410') HTTP/1.1" 204 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for YC00182: 2
2026-03-29 10:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-29 10:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with scrape type 2
2026-03-29 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with scrape type 2
2026-03-29 10:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a388c19-a9d9-55c9-9ef8-b907272e4d33, identifier: YC00182
2026-03-29 10:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-29 10:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182
2026-03-29 10:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a388c19-a9d9-55c9-9ef8-b907272e4d33 with identifier: YC00182 to the API
2026-03-29 10:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 625,
'expiration_date': '2026-03-30T15:25:06Z',
'fuel_type': 'petrol',
'id': '9a388c19-a9d9-55c9-9ef8-b907272e4d33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC00182',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 137023,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-19',
'seller_name': None,
'title': 'BMW X5 M Competition',
'transmission': 'automatic',
'trim': 'BW Competition',
'year': 2020}
2026-03-29 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-29 10:44:30 [auto1.de] INFO: Saving data for YC00182: {'auction_closing_time': 1774884306.0, 'created_time': 1773898433.80827, 'last_price_update_time': 1774781070.210978}
2026-03-29 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC00182') HTTP/1.1" 204 0
2026-03-29 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:33 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:33 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-29 10:44:33 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-29 10:44:33 [auto1.de] INFO: Scrape type for KZ11771: 2
2026-03-29 10:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-29 10:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 072680d4-0d47-5699-a1bb-d933ac3faae4 with scrape type 2
2026-03-29 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 072680d4-0d47-5699-a1bb-d933ac3faae4 with scrape type 2
2026-03-29 10:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 072680d4-0d47-5699-a1bb-d933ac3faae4, identifier: KZ11771
2026-03-29 10:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-29 10:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771
2026-03-29 10:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 072680d4-0d47-5699-a1bb-d933ac3faae4 with identifier: KZ11771 to the API
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:40:24Z',
'fuel_type': 'diesel',
'id': '072680d4-0d47-5699-a1bb-d933ac3faae4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ11771',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 179346,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-09',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CDI T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2009}
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-29 10:44:33 [auto1.de] INFO: Saving data for KZ11771: {'auction_closing_time': 1774885224.0, 'created_time': 1773469103.542024, 'last_price_update_time': 1774781073.404248}
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ11771') HTTP/1.1" 204 0
2026-03-29 10:44:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:33 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-29 10:44:33 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-29 10:44:33 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-29 10:44:33 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-29 10:44:33 [auto1.de] INFO: Scrape type for HJ16589: 2
2026-03-29 10:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-29 10:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d533f264-3c68-52e0-aefb-fee3a98eab18 with scrape type 2
2026-03-29 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d533f264-3c68-52e0-aefb-fee3a98eab18 with scrape type 2
2026-03-29 10:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d533f264-3c68-52e0-aefb-fee3a98eab18, identifier: HJ16589
2026-03-29 10:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-29 10:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589
2026-03-29 10:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d533f264-3c68-52e0-aefb-fee3a98eab18 with identifier: HJ16589 to the API
2026-03-29 10:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:08Z',
'fuel_type': 'petrol',
'id': 'd533f264-3c68-52e0-aefb-fee3a98eab18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ16589',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 66536,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-24',
'seller_name': None,
'title': 'Volkswagen Beetle 1.4 TSI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-29 10:44:34 [auto1.de] INFO: Saving data for HJ16589: {'auction_closing_time': 1774885688.0, 'created_time': 1774118537.586079, 'last_price_update_time': 1774781074.426849}
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ16589') HTTP/1.1" 204 0
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-29 10:44:34 [auto1.de] INFO: Scrape type for KM53361: 2
2026-03-29 10:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-29 10:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with scrape type 2
2026-03-29 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with scrape type 2
2026-03-29 10:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125, identifier: KM53361
2026-03-29 10:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-29 10:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361
2026-03-29 10:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125 with identifier: KM53361 to the API
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:10Z',
'fuel_type': 'petrol',
'id': '66c0f22b-cbb7-5e8d-b3ee-65f4fa80b125',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM53361',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 108563,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-18',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2015}
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-29 10:44:34 [auto1.de] INFO: Saving data for KM53361: {'auction_closing_time': 1774885810.0, 'created_time': 1774032813.279066, 'last_price_update_time': 1774781074.851209}
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM53361') HTTP/1.1" 204 0
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-29 10:44:34 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-29 10:44:34 [auto1.de] INFO: Scrape type for PU74458: 2
2026-03-29 10:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-29 10:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c7fc49-a7c0-518c-984b-ffb89675dd3b with scrape type 2
2026-03-29 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c7fc49-a7c0-518c-984b-ffb89675dd3b with scrape type 2
2026-03-29 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20c7fc49-a7c0-518c-984b-ffb89675dd3b, identifier: PU74458
2026-03-29 10:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-29 10:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458
2026-03-29 10:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20c7fc49-a7c0-518c-984b-ffb89675dd3b with identifier: PU74458 to the API
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 152,
'expiration_date': '2026-03-30T15:38:44Z',
'fuel_type': 'diesel',
'id': '20c7fc49-a7c0-518c-984b-ffb89675dd3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU74458',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 163279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-20',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Trend 2WD',
'transmission': 'automatic',
'trim': 'Trend 2WD',
'year': 2020}
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-29 10:44:35 [auto1.de] INFO: Saving data for PU74458: {'auction_closing_time': 1774885124.0, 'created_time': 1773467233.425054, 'last_price_update_time': 1774781075.366452}
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU74458') HTTP/1.1" 204 0
2026-03-29 10:44:35 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-29 10:44:35 [auto1.de] INFO: Scrape type for NK23311: 2
2026-03-29 10:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-29 10:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with scrape type 2
2026-03-29 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with scrape type 2
2026-03-29 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec, identifier: NK23311
2026-03-29 10:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-29 10:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311
2026-03-29 10:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0e70dff-d9ca-5752-a0ca-21a4efbb68ec with identifier: NK23311 to the API
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:22:35Z',
'fuel_type': 'diesel',
'id': 'f0e70dff-d9ca-5752-a0ca-21a4efbb68ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK23311',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 209235,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-31',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-29 10:44:35 [auto1.de] INFO: Saving data for NK23311: {'auction_closing_time': 1774884155.0, 'created_time': 1773340532.785804, 'last_price_update_time': 1774781075.803866}
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK23311') HTTP/1.1" 204 0
2026-03-29 10:44:35 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-29 10:44:35 [auto1.de] INFO: Scrape type for HP69948: 2
2026-03-29 10:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-29 10:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1d31c80-ff22-5695-b17a-80dea157cc43 with scrape type 2
2026-03-29 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1d31c80-ff22-5695-b17a-80dea157cc43 with scrape type 2
2026-03-29 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1d31c80-ff22-5695-b17a-80dea157cc43, identifier: HP69948
2026-03-29 10:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-29 10:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948
2026-03-29 10:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1d31c80-ff22-5695-b17a-80dea157cc43 with identifier: HP69948 to the API
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:55:22Z',
'fuel_type': 'petrol',
'id': 'b1d31c80-ff22-5695-b17a-80dea157cc43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP69948',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 152439,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-30',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-29 10:44:36 [auto1.de] INFO: Saving data for HP69948: {'auction_closing_time': 1774886122.0, 'created_time': 1774550009.091038, 'last_price_update_time': 1774781076.242121}
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP69948') HTTP/1.1" 204 0
2026-03-29 10:44:36 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-29 10:44:36 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-29 10:44:36 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-29 10:44:36 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19312%27 HTTP/1.1" 200 None
2026-03-29 10:44:36 [auto1.de] INFO: Scrape type for YJ19312: 2
2026-03-29 10:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77508fb4-e836-5715-98ca-619c10a5c23d with identifier: YJ19312
2026-03-29 10:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77508fb4-e836-5715-98ca-619c10a5c23d with scrape type 2
2026-03-29 10:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77508fb4-e836-5715-98ca-619c10a5c23d with scrape type 2
2026-03-29 10:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77508fb4-e836-5715-98ca-619c10a5c23d, identifier: YJ19312
2026-03-29 10:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77508fb4-e836-5715-98ca-619c10a5c23d with identifier: YJ19312
2026-03-29 10:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77508fb4-e836-5715-98ca-619c10a5c23d with identifier: YJ19312
2026-03-29 10:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77508fb4-e836-5715-98ca-619c10a5c23d with identifier: YJ19312 to the API
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:15:40Z',
'fuel_type': 'diesel',
'id': '77508fb4-e836-5715-98ca-619c10a5c23d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ19312',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Santa Fe',
'odometer': 141082,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-02',
'seller_name': None,
'title': 'Hyundai Santa Fe 2.2 CRDi Premium 4WD',
'transmission': 'automatic',
'trim': 'Premium 4WD',
'year': 2018}
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19312%27 HTTP/1.1" 200 None
2026-03-29 10:44:36 [auto1.de] INFO: Saving data for YJ19312: {'auction_closing_time': 1774883740.0, 'created_time': 1774694202.756457, 'last_price_update_time': 1774781076.635558}
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ19312') HTTP/1.1" 204 0
2026-03-29 10:44:36 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-29 10:44:36 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-29 10:44:36 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-29 10:44:36 [auto1.de] INFO: Scrape type for NE48651: 2
2026-03-29 10:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-29 10:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb8350f-f58c-5550-9d2f-01aafce80dcc with scrape type 2
2026-03-29 10:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eb8350f-f58c-5550-9d2f-01aafce80dcc with scrape type 2
2026-03-29 10:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0eb8350f-f58c-5550-9d2f-01aafce80dcc, identifier: NE48651
2026-03-29 10:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-29 10:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651
2026-03-29 10:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0eb8350f-f58c-5550-9d2f-01aafce80dcc with identifier: NE48651 to the API
2026-03-29 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:05:40Z',
'fuel_type': 'diesel',
'id': '0eb8350f-f58c-5550-9d2f-01aafce80dcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE48651',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 169912,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-06',
'seller_name': None,
'title': 'BMW 3er 320d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2011}
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-29 10:44:37 [auto1.de] INFO: Saving data for NE48651: {'auction_closing_time': 1774883140.0, 'created_time': 1774694196.858969, 'last_price_update_time': 1774781077.133276}
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE48651') HTTP/1.1" 204 0
2026-03-29 10:44:37 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-29 10:44:37 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-29 10:44:37 [auto1.de] INFO: Scrape type for BA78869: 2
2026-03-29 10:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-29 10:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d50ff8-0666-5550-b36e-7b62fea35fd5 with scrape type 2
2026-03-29 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95d50ff8-0666-5550-b36e-7b62fea35fd5 with scrape type 2
2026-03-29 10:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95d50ff8-0666-5550-b36e-7b62fea35fd5, identifier: BA78869
2026-03-29 10:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-29 10:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869
2026-03-29 10:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95d50ff8-0666-5550-b36e-7b62fea35fd5 with identifier: BA78869 to the API
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:11:41Z',
'fuel_type': 'diesel',
'id': '95d50ff8-0666-5550-b36e-7b62fea35fd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA78869',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 360764,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-19',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2007}
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-29 10:44:37 [auto1.de] INFO: Saving data for BA78869: {'auction_closing_time': 1774883501.0, 'created_time': 1774694215.54303, 'last_price_update_time': 1774781077.914897}
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA78869') HTTP/1.1" 204 0
2026-03-29 10:44:37 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-29 10:44:37 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-29 10:44:37 [auto1.de] INFO: Scrape type for DJ78015: 2
2026-03-29 10:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-29 10:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6d22b5-1389-50e5-abed-e854a99960df with scrape type 2
2026-03-29 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a6d22b5-1389-50e5-abed-e854a99960df with scrape type 2
2026-03-29 10:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a6d22b5-1389-50e5-abed-e854a99960df, identifier: DJ78015
2026-03-29 10:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-29 10:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015
2026-03-29 10:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a6d22b5-1389-50e5-abed-e854a99960df with identifier: DJ78015 to the API
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 83,
'expiration_date': '2026-03-30T15:02:17Z',
'fuel_type': 'petrol',
'id': '8a6d22b5-1389-50e5-abed-e854a99960df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ78015',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Ignis',
'odometer': 9299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-28',
'seller_name': None,
'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2020}
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-29 10:44:38 [auto1.de] INFO: Saving data for DJ78015: {'auction_closing_time': 1774882937.0, 'created_time': 1774694199.829345, 'last_price_update_time': 1774781078.358423}
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ78015') HTTP/1.1" 204 0
2026-03-29 10:44:38 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-29 10:44:38 [auto1.de] INFO: Scrape type for SM71650: 2
2026-03-29 10:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-29 10:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2bb0b73-1335-5937-87cb-e159b6fc6b70 with scrape type 2
2026-03-29 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2bb0b73-1335-5937-87cb-e159b6fc6b70 with scrape type 2
2026-03-29 10:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2bb0b73-1335-5937-87cb-e159b6fc6b70, identifier: SM71650
2026-03-29 10:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-29 10:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650
2026-03-29 10:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2bb0b73-1335-5937-87cb-e159b6fc6b70 with identifier: SM71650 to the API
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:09:53Z',
'fuel_type': 'petrol',
'id': 'c2bb0b73-1335-5937-87cb-e159b6fc6b70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM71650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 99464,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-27',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2022}
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-29 10:44:38 [auto1.de] INFO: Saving data for SM71650: {'auction_closing_time': 1774883393.0, 'created_time': 1773467238.566988, 'last_price_update_time': 1774781078.810779}
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM71650') HTTP/1.1" 204 0
2026-03-29 10:44:38 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-29 10:44:38 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-29 10:44:38 [auto1.de] INFO: Scrape type for ZU52934: 2
2026-03-29 10:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-29 10:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5eb92e6-1352-56b0-91aa-325a6ea0f107 with scrape type 2
2026-03-29 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5eb92e6-1352-56b0-91aa-325a6ea0f107 with scrape type 2
2026-03-29 10:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5eb92e6-1352-56b0-91aa-325a6ea0f107, identifier: ZU52934
2026-03-29 10:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-29 10:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934
2026-03-29 10:44:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5eb92e6-1352-56b0-91aa-325a6ea0f107 with identifier: ZU52934 to the API
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:09:35Z',
'fuel_type': 'diesel',
'id': 'c5eb92e6-1352-56b0-91aa-325a6ea0f107',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU52934',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 293441,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-30',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2013}
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-29 10:44:39 [auto1.de] INFO: Saving data for ZU52934: {'auction_closing_time': 1774883375.0, 'created_time': 1773427027.386419, 'last_price_update_time': 1774781079.24571}
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU52934') HTTP/1.1" 204 0
2026-03-29 10:44:39 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-29 10:44:39 [auto1.de] INFO: Scrape type for PW89679: 2
2026-03-29 10:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-29 10:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with scrape type 2
2026-03-29 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with scrape type 2
2026-03-29 10:44:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31, identifier: PW89679
2026-03-29 10:44:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-29 10:44:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679
2026-03-29 10:44:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29da9e3e-0669-5962-8ac1-a3bfcfb4cb31 with identifier: PW89679 to the API
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:30:10Z',
'fuel_type': 'petrol',
'id': '29da9e3e-0669-5962-8ac1-a3bfcfb4cb31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW89679',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 160628,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-09',
'seller_name': None,
'title': 'Hyundai i20 1.0 TGDI YES! Plus',
'transmission': 'manual',
'trim': 'YES! Plus',
'year': 2017}
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-29 10:44:39 [auto1.de] INFO: Saving data for PW89679: {'auction_closing_time': 1774884610.0, 'created_time': 1774349711.149055, 'last_price_update_time': 1774781079.692802}
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW89679') HTTP/1.1" 204 0
2026-03-29 10:44:39 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-29 10:44:39 [auto1.de] INFO: Scrape type for GD61279: 2
2026-03-29 10:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-29 10:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 869db8af-68c6-5fea-be14-893facef5e63 with scrape type 2
2026-03-29 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 869db8af-68c6-5fea-be14-893facef5e63 with scrape type 2
2026-03-29 10:44:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 869db8af-68c6-5fea-be14-893facef5e63, identifier: GD61279
2026-03-29 10:44:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-29 10:44:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279
2026-03-29 10:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 869db8af-68c6-5fea-be14-893facef5e63 with identifier: GD61279 to the API
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:59:01Z',
'fuel_type': 'petrol',
'id': '869db8af-68c6-5fea-be14-893facef5e63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD61279',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 25398,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-13',
'seller_name': None,
'title': 'Audi A1 Sportback 1.0 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Saving data for GD61279: {'auction_closing_time': 1774886341.0, 'created_time': 1774032379.306741, 'last_price_update_time': 1774781080.212768}
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD61279') HTTP/1.1" 204 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for KU32415: 2
2026-03-29 10:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-29 10:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03b29617-0326-54fd-be2c-fbb04bea1850 with scrape type 2
2026-03-29 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03b29617-0326-54fd-be2c-fbb04bea1850 with scrape type 2
2026-03-29 10:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03b29617-0326-54fd-be2c-fbb04bea1850, identifier: KU32415
2026-03-29 10:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-29 10:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415
2026-03-29 10:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03b29617-0326-54fd-be2c-fbb04bea1850 with identifier: KU32415 to the API
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:11:01Z',
'fuel_type': 'diesel',
'id': '03b29617-0326-54fd-be2c-fbb04bea1850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU32415',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery 5',
'odometer': 150093,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-30',
'seller_name': None,
'title': 'Land Rover Discovery 5 3.0 Td6 HSE LUXURY',
'transmission': 'automatic',
'trim': 'HSE LUXURY',
'year': 2018}
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Saving data for KU32415: {'auction_closing_time': 1774883461.0, 'created_time': 1774032362.913793, 'last_price_update_time': 1774781080.695964}
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU32415') HTTP/1.1" 204 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for NG84191: 2
2026-03-29 10:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-29 10:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with scrape type 2
2026-03-29 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with scrape type 2
2026-03-29 10:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a, identifier: NG84191
2026-03-29 10:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-29 10:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191
2026-03-29 10:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82a698c1-2f25-5677-a8ae-3ea1784e3a0a with identifier: NG84191 to the API
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:50:19Z',
'fuel_type': 'diesel',
'id': '82a698c1-2f25-5677-a8ae-3ea1784e3a0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG84191',
'listing': 'auction',
'make': 'Subaru',
'model': 'XV',
'odometer': 159110,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-21',
'seller_name': None,
'title': 'Subaru XV 2.0 Diesel Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2016}
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Saving data for NG84191: {'auction_closing_time': 1774885819.0, 'created_time': 1774694207.684197, 'last_price_update_time': 1774781081.155002}
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG84191') HTTP/1.1" 204 0
2026-03-29 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:42 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for UX99567: 2
2026-03-29 10:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-29 10:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a2a255-386b-5a9d-819e-981db8359b0b with scrape type 2
2026-03-29 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a2a255-386b-5a9d-819e-981db8359b0b with scrape type 2
2026-03-29 10:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a2a255-386b-5a9d-819e-981db8359b0b, identifier: UX99567
2026-03-29 10:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-29 10:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567
2026-03-29 10:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a2a255-386b-5a9d-819e-981db8359b0b with identifier: UX99567 to the API
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:25:15Z',
'fuel_type': 'petrol',
'id': '43a2a255-386b-5a9d-819e-981db8359b0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX99567',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 164698,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-04',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Saving data for UX99567: {'auction_closing_time': 1774884315.0, 'created_time': 1774349179.552114, 'last_price_update_time': 1774781083.083519}
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX99567') HTTP/1.1" 204 0
2026-03-29 10:44:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for SR86923: 2
2026-03-29 10:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-29 10:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 067b3bf7-9c0e-549b-8d66-28ef27264a53 with scrape type 2
2026-03-29 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 067b3bf7-9c0e-549b-8d66-28ef27264a53 with scrape type 2
2026-03-29 10:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 067b3bf7-9c0e-549b-8d66-28ef27264a53, identifier: SR86923
2026-03-29 10:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-29 10:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923
2026-03-29 10:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 067b3bf7-9c0e-549b-8d66-28ef27264a53 with identifier: SR86923 to the API
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:22:40Z',
'fuel_type': 'petrol',
'id': '067b3bf7-9c0e-549b-8d66-28ef27264a53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR86923',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 132944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-22',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2018}
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Saving data for SR86923: {'auction_closing_time': 1774884160.0, 'created_time': 1773426846.074432, 'last_price_update_time': 1774781083.515132}
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR86923') HTTP/1.1" 204 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for ZX68256: 2
2026-03-29 10:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-29 10:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 148a4ffc-eed3-5dea-ac00-3894180a0b24 with scrape type 2
2026-03-29 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 148a4ffc-eed3-5dea-ac00-3894180a0b24 with scrape type 2
2026-03-29 10:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 148a4ffc-eed3-5dea-ac00-3894180a0b24, identifier: ZX68256
2026-03-29 10:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-29 10:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256
2026-03-29 10:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 148a4ffc-eed3-5dea-ac00-3894180a0b24 with identifier: ZX68256 to the API
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:23:45Z',
'fuel_type': 'diesel',
'id': '148a4ffc-eed3-5dea-ac00-3894180a0b24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX68256',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 237615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-25',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': '4Matic BlueTEC Avantgarde',
'year': 2015}
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Saving data for ZX68256: {'auction_closing_time': 1774884225.0, 'created_time': 1774089046.74303, 'last_price_update_time': 1774781083.937512}
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX68256') HTTP/1.1" 204 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for CZ39134: 2
2026-03-29 10:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-29 10:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528b345b-aec1-5f55-a634-2d0632c91f25 with scrape type 2
2026-03-29 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 528b345b-aec1-5f55-a634-2d0632c91f25 with scrape type 2
2026-03-29 10:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 528b345b-aec1-5f55-a634-2d0632c91f25, identifier: CZ39134
2026-03-29 10:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-29 10:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134
2026-03-29 10:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 528b345b-aec1-5f55-a634-2d0632c91f25 with identifier: CZ39134 to the API
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:26:39Z',
'fuel_type': 'diesel',
'id': '528b345b-aec1-5f55-a634-2d0632c91f25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ39134',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 87938,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-25',
'seller_name': None,
'title': 'Peugeot 508 1.6 HDi Business Pack',
'transmission': 'automatic',
'trim': 'Business Pack',
'year': 2012}
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Saving data for CZ39134: {'auction_closing_time': 1774884399.0, 'created_time': 1774350166.249739, 'last_price_update_time': 1774781084.471362}
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ39134') HTTP/1.1" 204 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for EU15499: 2
2026-03-29 10:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-29 10:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4eb7213-36c4-5868-9c40-af4bbaaa996c with scrape type 2
2026-03-29 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4eb7213-36c4-5868-9c40-af4bbaaa996c with scrape type 2
2026-03-29 10:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4eb7213-36c4-5868-9c40-af4bbaaa996c, identifier: EU15499
2026-03-29 10:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-29 10:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499
2026-03-29 10:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4eb7213-36c4-5868-9c40-af4bbaaa996c with identifier: EU15499 to the API
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 201,
'expiration_date': '2026-03-30T15:12:58Z',
'fuel_type': 'diesel',
'id': 'f4eb7213-36c4-5868-9c40-af4bbaaa996c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU15499',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 108717,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-12',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Platinum 4WD',
'transmission': 'automatic',
'trim': 'Platinum 4WD',
'year': 2021}
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Saving data for EU15499: {'auction_closing_time': 1774883578.0, 'created_time': 1774089317.9504, 'last_price_update_time': 1774781085.216853}
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU15499') HTTP/1.1" 204 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for HG48100: 2
2026-03-29 10:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-29 10:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39868fd1-b93c-58a8-a754-545dcc2c6020 with scrape type 2
2026-03-29 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39868fd1-b93c-58a8-a754-545dcc2c6020 with scrape type 2
2026-03-29 10:44:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39868fd1-b93c-58a8-a754-545dcc2c6020, identifier: HG48100
2026-03-29 10:44:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-29 10:44:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100
2026-03-29 10:44:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39868fd1-b93c-58a8-a754-545dcc2c6020 with identifier: HG48100 to the API
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:40:34Z',
'fuel_type': 'petrol',
'id': '39868fd1-b93c-58a8-a754-545dcc2c6020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG48100',
'listing': 'auction',
'make': 'Dacia',
'model': 'Dokker',
'odometer': 106937,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-19',
'seller_name': None,
'title': 'Dacia Dokker 1.3 TCe Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2020}
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Saving data for HG48100: {'auction_closing_time': 1774885234.0, 'created_time': 1774466689.460129, 'last_price_update_time': 1774781085.722271}
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG48100') HTTP/1.1" 204 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for WA68058: 2
2026-03-29 10:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-29 10:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with scrape type 2
2026-03-29 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with scrape type 2
2026-03-29 10:44:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb, identifier: WA68058
2026-03-29 10:44:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-29 10:44:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058
2026-03-29 10:44:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b16628e5-1d13-5bc3-aefe-ab3aedcaabcb with identifier: WA68058 to the API
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:52:25Z',
'fuel_type': 'petrol',
'id': 'b16628e5-1d13-5bc3-aefe-ab3aedcaabcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA68058',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 105623,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-21',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2013}
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Saving data for WA68058: {'auction_closing_time': 1774885945.0, 'created_time': 1774694216.161216, 'last_price_update_time': 1774781086.243157}
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA68058') HTTP/1.1" 204 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for RZ05971: 2
2026-03-29 10:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-29 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba536df-8a11-5edd-9674-7308885b4298 with scrape type 2
2026-03-29 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba536df-8a11-5edd-9674-7308885b4298 with scrape type 2
2026-03-29 10:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cba536df-8a11-5edd-9674-7308885b4298, identifier: RZ05971
2026-03-29 10:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-29 10:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971
2026-03-29 10:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cba536df-8a11-5edd-9674-7308885b4298 with identifier: RZ05971 to the API
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:57:58Z',
'fuel_type': 'petrol',
'id': 'cba536df-8a11-5edd-9674-7308885b4298',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ05971',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 75673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-11',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2019}
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Saving data for RZ05971: {'auction_closing_time': 1774886278.0, 'created_time': 1773466726.012505, 'last_price_update_time': 1774781086.789528}
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ05971') HTTP/1.1" 204 0
2026-03-29 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for VL73605: 2
2026-03-29 10:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-29 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7456bbbf-6730-5685-a3a1-c8d69613b341 with scrape type 2
2026-03-29 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7456bbbf-6730-5685-a3a1-c8d69613b341 with scrape type 2
2026-03-29 10:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7456bbbf-6730-5685-a3a1-c8d69613b341, identifier: VL73605
2026-03-29 10:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-29 10:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605
2026-03-29 10:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7456bbbf-6730-5685-a3a1-c8d69613b341 with identifier: VL73605 to the API
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:03:43Z',
'fuel_type': 'diesel',
'id': '7456bbbf-6730-5685-a3a1-c8d69613b341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL73605',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 211789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-31',
'seller_name': None,
'title': 'Audi A5 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-29 10:44:47 [auto1.de] INFO: Saving data for VL73605: {'auction_closing_time': 1774883023.0, 'created_time': 1773340516.652333, 'last_price_update_time': 1774781087.22946}
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL73605') HTTP/1.1" 204 0
2026-03-29 10:44:47 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-29 10:44:47 [auto1.de] INFO: Scrape type for TZ58013: 2
2026-03-29 10:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-29 10:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ad947f-1293-59d3-b453-be4bb6e6c61c with scrape type 2
2026-03-29 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ad947f-1293-59d3-b453-be4bb6e6c61c with scrape type 2
2026-03-29 10:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97ad947f-1293-59d3-b453-be4bb6e6c61c, identifier: TZ58013
2026-03-29 10:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-29 10:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013
2026-03-29 10:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97ad947f-1293-59d3-b453-be4bb6e6c61c with identifier: TZ58013 to the API
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:15:05Z',
'fuel_type': 'petrol',
'id': '97ad947f-1293-59d3-b453-be4bb6e6c61c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ58013',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 48064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-28',
'seller_name': None,
'title': 'Seat Arona 1.0 TSI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2020}
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-29 10:44:47 [auto1.de] INFO: Saving data for TZ58013: {'auction_closing_time': 1774883705.0, 'created_time': 1773426943.676638, 'last_price_update_time': 1774781087.802272}
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ58013') HTTP/1.1" 204 0
2026-03-29 10:44:47 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:47 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-29 10:44:47 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-29 10:44:47 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-29 10:44:47 [auto1.de] INFO: Scrape type for MG73872: 2
2026-03-29 10:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-29 10:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d88997-887b-52df-893c-fbc710dc53df with scrape type 2
2026-03-29 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d88997-887b-52df-893c-fbc710dc53df with scrape type 2
2026-03-29 10:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d88997-887b-52df-893c-fbc710dc53df, identifier: MG73872
2026-03-29 10:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-29 10:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872
2026-03-29 10:44:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d88997-887b-52df-893c-fbc710dc53df with identifier: MG73872 to the API
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:34:36Z',
'fuel_type': 'diesel',
'id': 'f8d88997-887b-52df-893c-fbc710dc53df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG73872',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 253612,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-13',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
'transmission': 'manual',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Saving data for MG73872: {'auction_closing_time': 1774884876.0, 'created_time': 1774118525.518917, 'last_price_update_time': 1774781088.227223}
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG73872') HTTP/1.1" 204 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for WA60872: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for RJ17594: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for WC98530: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for ET93890: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for DV01854: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for UE23148: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for ZS91776: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for VX64192: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for ED17592: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for FX10664: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for YS85041: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for WG54603: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for VV82390: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for SK64465: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for GY99851: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for KG73349: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for ZZ82496: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for MA81744: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for KG50767: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for AR70360: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for XL74124: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for WX78972: 0
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-29 10:44:48 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Scrape type for RM35826: 2
2026-03-29 10:44:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-29 10:44:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befa60f4-4c17-5a6a-b92f-9395611faa5f with scrape type 2
2026-03-29 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item befa60f4-4c17-5a6a-b92f-9395611faa5f with scrape type 2
2026-03-29 10:44:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: befa60f4-4c17-5a6a-b92f-9395611faa5f, identifier: RM35826
2026-03-29 10:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-29 10:44:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826
2026-03-29 10:44:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: befa60f4-4c17-5a6a-b92f-9395611faa5f with identifier: RM35826 to the API
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:08:22Z',
'fuel_type': 'diesel',
'id': 'befa60f4-4c17-5a6a-b92f-9395611faa5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM35826',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 208378,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-30',
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-29 10:44:48 [auto1.de] INFO: Saving data for RM35826: {'auction_closing_time': 1774883302.0, 'created_time': 1774034162.820759, 'last_price_update_time': 1774781088.989778}
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM35826') HTTP/1.1" 204 0
2026-03-29 10:44:49 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-29 10:44:49 [auto1.de] INFO: Scrape type for EH57829: 2
2026-03-29 10:44:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-29 10:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97710850-f158-5fa6-af3c-4dad60e26c07 with scrape type 2
2026-03-29 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97710850-f158-5fa6-af3c-4dad60e26c07 with scrape type 2
2026-03-29 10:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97710850-f158-5fa6-af3c-4dad60e26c07, identifier: EH57829
2026-03-29 10:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-29 10:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829
2026-03-29 10:44:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97710850-f158-5fa6-af3c-4dad60e26c07 with identifier: EH57829 to the API
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:23:56Z',
'fuel_type': 'petrol',
'id': '97710850-f158-5fa6-af3c-4dad60e26c07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH57829',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 20429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-08',
'seller_name': None,
'title': 'Hyundai ix20 1.4 25 Aniversario',
'transmission': 'manual',
'trim': '25 Aniversario',
'year': 2016}
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-29 10:44:49 [auto1.de] INFO: Saving data for EH57829: {'auction_closing_time': 1774884236.0, 'created_time': 1774694220.241338, 'last_price_update_time': 1774781089.521796}
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH57829') HTTP/1.1" 204 0
2026-03-29 10:44:49 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-29 10:44:49 [auto1.de] INFO: Scrape type for GR42785: 2
2026-03-29 10:44:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-29 10:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc646d6b-7c20-506b-9143-884e56f2e2a8 with scrape type 2
2026-03-29 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc646d6b-7c20-506b-9143-884e56f2e2a8 with scrape type 2
2026-03-29 10:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc646d6b-7c20-506b-9143-884e56f2e2a8, identifier: GR42785
2026-03-29 10:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-29 10:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785
2026-03-29 10:44:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc646d6b-7c20-506b-9143-884e56f2e2a8 with identifier: GR42785 to the API
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:28:23Z',
'fuel_type': 'diesel',
'id': 'dc646d6b-7c20-506b-9143-884e56f2e2a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR42785',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 150812,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-09',
'seller_name': None,
'title': 'BMW 5er 520d Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2018}
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-29 10:44:49 [auto1.de] INFO: Saving data for GR42785: {'auction_closing_time': 1774884503.0, 'created_time': 1774032523.269895, 'last_price_update_time': 1774781089.934189}
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR42785') HTTP/1.1" 204 0
2026-03-29 10:44:49 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-29 10:44:49 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-29 10:44:49 [auto1.de] INFO: Scrape type for MM73538: 2
2026-03-29 10:44:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-29 10:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0880bdfe-8678-5703-9558-41b3f6241536 with scrape type 2
2026-03-29 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0880bdfe-8678-5703-9558-41b3f6241536 with scrape type 2
2026-03-29 10:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0880bdfe-8678-5703-9558-41b3f6241536, identifier: MM73538
2026-03-29 10:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-29 10:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538
2026-03-29 10:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0880bdfe-8678-5703-9558-41b3f6241536 with identifier: MM73538 to the API
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:28:51Z',
'fuel_type': 'diesel',
'id': '0880bdfe-8678-5703-9558-41b3f6241536',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM73538',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Kombi',
'odometer': 272486,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-10',
'seller_name': None,
'title': 'Volkswagen T5 Kombi 2.0 TDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2011}
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-29 10:44:50 [auto1.de] INFO: Saving data for MM73538: {'auction_closing_time': 1774884531.0, 'created_time': 1774694285.611527, 'last_price_update_time': 1774781090.360137}
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM73538') HTTP/1.1" 204 0
2026-03-29 10:44:50 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-29 10:44:50 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-29 10:44:50 [auto1.de] INFO: Scrape type for AH24505: 2
2026-03-29 10:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-29 10:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with scrape type 2
2026-03-29 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with scrape type 2
2026-03-29 10:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8421d342-f1a6-5edf-af7c-ef54e49bedc4, identifier: AH24505
2026-03-29 10:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-29 10:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505
2026-03-29 10:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8421d342-f1a6-5edf-af7c-ef54e49bedc4 with identifier: AH24505 to the API
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:10:33Z',
'fuel_type': 'petrol',
'id': '8421d342-f1a6-5edf-af7c-ef54e49bedc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH24505',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 165755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-25',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Cup',
'transmission': 'manual',
'trim': 'Cup',
'year': 2015}
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-29 10:44:50 [auto1.de] INFO: Saving data for AH24505: {'auction_closing_time': 1774883433.0, 'created_time': 1774002232.691175, 'last_price_update_time': 1774781090.765045}
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH24505') HTTP/1.1" 204 0
2026-03-29 10:44:50 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-29 10:44:50 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-29 10:44:50 [auto1.de] INFO: Scrape type for RF00811: 2
2026-03-29 10:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-29 10:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155c56ae-f46b-51b9-9e6e-c431a6bce839 with scrape type 2
2026-03-29 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 155c56ae-f46b-51b9-9e6e-c431a6bce839 with scrape type 2
2026-03-29 10:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 155c56ae-f46b-51b9-9e6e-c431a6bce839, identifier: RF00811
2026-03-29 10:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-29 10:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811
2026-03-29 10:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 155c56ae-f46b-51b9-9e6e-c431a6bce839 with identifier: RF00811 to the API
2026-03-29 10:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:04:34Z',
'fuel_type': 'diesel',
'id': '155c56ae-f46b-51b9-9e6e-c431a6bce839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF00811',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 197615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-19',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Bi-Turbo Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2017}
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-29 10:44:51 [auto1.de] INFO: Saving data for RF00811: {'auction_closing_time': 1774883074.0, 'created_time': 1774694219.449667, 'last_price_update_time': 1774781091.185909}
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF00811') HTTP/1.1" 204 0
2026-03-29 10:44:51 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-29 10:44:51 [auto1.de] INFO: Scrape type for CA70430: 2
2026-03-29 10:44:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-29 10:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47645817-adc9-52c0-a905-ec71983c9669 with scrape type 2
2026-03-29 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47645817-adc9-52c0-a905-ec71983c9669 with scrape type 2
2026-03-29 10:44:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47645817-adc9-52c0-a905-ec71983c9669, identifier: CA70430
2026-03-29 10:44:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-29 10:44:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430
2026-03-29 10:44:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47645817-adc9-52c0-a905-ec71983c9669 with identifier: CA70430 to the API
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:24:48Z',
'fuel_type': 'diesel',
'id': '47645817-adc9-52c0-a905-ec71983c9669',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA70430',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 230367,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-05',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-29 10:44:51 [auto1.de] INFO: Saving data for CA70430: {'auction_closing_time': 1774884288.0, 'created_time': 1773427209.387325, 'last_price_update_time': 1774781091.66614}
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA70430') HTTP/1.1" 204 0
2026-03-29 10:44:51 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-29 10:44:51 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-29 10:44:51 [auto1.de] INFO: Scrape type for AZ56926: 2
2026-03-29 10:44:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-29 10:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with scrape type 2
2026-03-29 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with scrape type 2
2026-03-29 10:44:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94b77a11-6ac3-5fcc-b310-2d81855a4d86, identifier: AZ56926
2026-03-29 10:44:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-29 10:44:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926
2026-03-29 10:44:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94b77a11-6ac3-5fcc-b310-2d81855a4d86 with identifier: AZ56926 to the API
2026-03-29 10:44:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:34:23Z',
'fuel_type': 'petrol',
'id': '94b77a11-6ac3-5fcc-b310-2d81855a4d86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ56926',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 105843,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-17',
'seller_name': None,
'title': 'Skoda Fabia 1.6 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-29 10:44:52 [auto1.de] INFO: Saving data for AZ56926: {'auction_closing_time': 1774884863.0, 'created_time': 1774089480.171647, 'last_price_update_time': 1774781092.143307}
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ56926') HTTP/1.1" 204 0
2026-03-29 10:44:52 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-29 10:44:52 [auto1.de] INFO: Scrape type for GY33643: 2
2026-03-29 10:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-29 10:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d32802e-9aba-5601-81c5-9bd394276e39 with scrape type 2
2026-03-29 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d32802e-9aba-5601-81c5-9bd394276e39 with scrape type 2
2026-03-29 10:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d32802e-9aba-5601-81c5-9bd394276e39, identifier: GY33643
2026-03-29 10:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-29 10:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643
2026-03-29 10:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d32802e-9aba-5601-81c5-9bd394276e39 with identifier: GY33643 to the API
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 99,
'expiration_date': '2026-03-30T15:48:54Z',
'fuel_type': 'petrol',
'id': '6d32802e-9aba-5601-81c5-9bd394276e39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY33643',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 63837,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-29',
'seller_name': None,
'title': 'Hyundai i30 1.4 MPI Select',
'transmission': 'manual',
'trim': 'Select',
'year': 2018}
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-29 10:44:52 [auto1.de] INFO: Saving data for GY33643: {'auction_closing_time': 1774885734.0, 'created_time': 1774349161.132458, 'last_price_update_time': 1774781092.759006}
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY33643') HTTP/1.1" 204 0
2026-03-29 10:44:52 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-29 10:44:52 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-29 10:44:52 [auto1.de] INFO: Scrape type for EK48004: 2
2026-03-29 10:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-29 10:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with scrape type 2
2026-03-29 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with scrape type 2
2026-03-29 10:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8, identifier: EK48004
2026-03-29 10:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-29 10:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004
2026-03-29 10:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd23a141-f8a7-52e7-ac9e-14210d0fe2a8 with identifier: EK48004 to the API
2026-03-29 10:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:22:00Z',
'fuel_type': 'diesel',
'id': 'dd23a141-f8a7-52e7-ac9e-14210d0fe2a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK48004',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 245523,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-11',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2015}
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-29 10:44:53 [auto1.de] INFO: Saving data for EK48004: {'auction_closing_time': 1774884120.0, 'created_time': 1774694235.166702, 'last_price_update_time': 1774781093.200501}
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK48004') HTTP/1.1" 204 0
2026-03-29 10:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:53 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-29 10:44:53 [auto1.de] INFO: Scrape type for WJ88731: 0
2026-03-29 10:44:53 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-29 10:44:53 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 6726 | hits on page: 6
2026-03-29 10:44:53 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-29 10:44:53 [auto1.de] INFO: Scrape type for TW02363: 0
2026-03-29 10:44:53 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-29 10:44:53 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-29 10:44:53 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-29 10:44:53 [auto1.de] INFO: Scrape type for YV43994: 0
2026-03-29 10:44:53 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-29 10:44:53 [auto1.de] INFO: Scrape type for HY99539: 0
2026-03-29 10:44:53 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-29 10:44:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:54 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 6726 | hits on page: 0
2026-03-29 10:44:54 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 10:44:54 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-29 10:44:54 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 4, <ScrapeType.BATCH_SKIPPED: 5>: 5}
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774349094 HTTP/1.1" 200 None
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE64540') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AM79685') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU31378') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW76033') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BD89348') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG00887') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BM23054') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BU45043') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CT59898') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG21137') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DN49155') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DP34384') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DT29379') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV69469') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EX81457') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FE58121') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FM12370') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FS59963') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GG20336') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GS61526') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU86547') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HD30680') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HF37399') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HK59987') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD38636') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JK85727') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH42842') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE44420') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LX54044') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK01483') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MM26482') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MY41636') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NE79990') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NK92157') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NP57826') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR30064') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PB07846') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PP32421') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PS70641') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE99972') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RF43430') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SV50873') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TB16210') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH48821') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH60262') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL15907') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL96759') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP24161') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TX40394') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC76963') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR44217') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VS17116') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC89947') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG99036') HTTP/1.1" 204 0
2026-03-29 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ86356') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WT56069') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ37937') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD99507') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XE09479') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL46338') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY38216') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YV78964') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YY95963') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD83381') HTTP/1.1" 204 0
2026-03-29 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM89950') HTTP/1.1" 204 0
2026-03-29 10:44:55 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (463 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-29T10_30_00.jl
2026-03-29 10:44:55 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 665586,
'downloader/request_count': 251,
'downloader/request_method_count/GET': 79,
'downloader/request_method_count/POST': 172,
'downloader/response_bytes': 31546456,
'downloader/response_count': 251,
'downloader/response_status_count/200': 251,
'dupefilter/filtered': 4,
'elapsed_time_seconds': 888.092468,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 29, 10, 44, 55, 72431, tzinfo=datetime.timezone.utc),
'item_scraped_count': 463,
'log_count/DEBUG': 11257,
'log_count/INFO': 14486,
'memusage/max': 171114496,
'memusage/startup': 147611648,
'photo_download_count': 15,
'request_depth_max': 173,
'response_received_count': 236,
'scheduler/dequeued': 251,
'scheduler/dequeued/memory': 251,
'scheduler/enqueued': 251,
'scheduler/enqueued/memory': 251,
'scrape_type/batch_skipped': 3405,
'scrape_type/new': 31,
'scrape_type/price_update': 432,
'scrape_type/skipped': 2894,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 242,
'scrapy-zyte-api/error_ratio': 0.024793388429752067,
'scrapy-zyte-api/errors': 6,
"scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 6,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 5.155900138209305,
'scrapy-zyte-api/mean_response_seconds': 5.258472512263053,
'scrapy-zyte-api/processed': 236,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 236,
'scrapy-zyte-api/request_args/experimental.requestCookies': 235,
'scrapy-zyte-api/request_args/experimental.responseCookies': 236,
'scrapy-zyte-api/request_args/httpRequestBody': 172,
'scrapy-zyte-api/request_args/httpRequestMethod': 172,
'scrapy-zyte-api/request_args/httpResponseBody': 236,
'scrapy-zyte-api/request_args/httpResponseHeaders': 236,
'scrapy-zyte-api/request_args/sessionContext': 236,
'scrapy-zyte-api/request_args/url': 236,
'scrapy-zyte-api/status_codes/0': 6,
'scrapy-zyte-api/status_codes/200': 236,
'scrapy-zyte-api/success': 236,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 6766,
'source/total_available': 6726,
'start_time': datetime.datetime(2026, 3, 29, 10, 30, 6, 979963, tzinfo=datetime.timezone.utc)}
2026-03-29 10:44:55 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 10:44:55 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f785cdad610>
2026-03-29 10:44:55 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f785cf5fc50>