2026-03-29 07:30:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 07:30:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 07:30:05 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-29 07:30:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-29 07:30:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 07:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 07:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 07:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 07:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 017ba5d902c59581
2026-03-29 07:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 07:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-29T07_30_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 07:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 07:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 07:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 07:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 07:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 07:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 07:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 07:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-29 07:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 07:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 07:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 07:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 07:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 07:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 07:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 07:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 07:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 07:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 07:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 07:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 07:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 07:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 07:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 07:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 07:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 07:30:16 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 6215 | hits on page: 40
2026-03-29 07:30:16 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-29 07:30:16 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-29 07:30:16 [auto1.de] INFO: Scrape type for YN38539: 2
2026-03-29 07:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-29 07:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with scrape type 2
2026-03-29 07:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with scrape type 2
2026-03-29 07:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7, identifier: YN38539
2026-03-29 07:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 07:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 07:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539
2026-03-29 07:30:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47b7bfe3-ae4d-5e64-9d48-b368bc428fe7 with identifier: YN38539 to the API
2026-03-29 07:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:50:24Z',
'fuel_type': 'petrol',
'id': '47b7bfe3-ae4d-5e64-9d48-b368bc428fe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN38539',
'listing': 'auction',
'make': 'Chrysler',
'model': 'Stratus',
'odometer': 69735,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-04-29',
'seller_name': None,
'title': 'Chrysler Stratus 2.5 V6 LX',
'transmission': 'automatic',
'trim': 'V6 LX',
'year': 1998}
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-29 07:30:17 [auto1.de] INFO: Saving data for YN38539: {'auction_closing_time': 1774885824.0, 'created_time': 1773228688.002477, 'last_price_update_time': 1774769417.281118}
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN38539') HTTP/1.1" 204 0
2026-03-29 07:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:30:17 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-29 07:30:17 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-29 07:30:17 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-29 07:30:17 [auto1.de] INFO: Scrape type for CG08693: 2
2026-03-29 07:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afd33eac-fed6-589a-a915-8acc63e4c9e5 with identifier: CG08693
2026-03-29 07:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afd33eac-fed6-589a-a915-8acc63e4c9e5 with scrape type 2
2026-03-29 07:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afd33eac-fed6-589a-a915-8acc63e4c9e5 with scrape type 2
2026-03-29 07:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afd33eac-fed6-589a-a915-8acc63e4c9e5, identifier: CG08693
2026-03-29 07:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afd33eac-fed6-589a-a915-8acc63e4c9e5 with identifier: CG08693
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 07:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 07:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afd33eac-fed6-589a-a915-8acc63e4c9e5 with identifier: CG08693
2026-03-29 07:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afd33eac-fed6-589a-a915-8acc63e4c9e5 with identifier: CG08693 to the API
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:15:25Z',
'fuel_type': 'diesel',
'id': 'afd33eac-fed6-589a-a915-8acc63e4c9e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG08693',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 78759,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-28',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 CRDi Premium 4WD',
'transmission': 'automatic',
'trim': 'Premium 4WD',
'year': 2020}
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-29 07:30:18 [auto1.de] INFO: Saving data for CG08693: {'auction_closing_time': 1774883725.0, 'created_time': 1773307411.686237, 'last_price_update_time': 1774769418.105776}
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG08693') HTTP/1.1" 204 0
2026-03-29 07:30:18 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-29 07:30:18 [auto1.de] INFO: Scrape type for LG10256: 2
2026-03-29 07:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd052d56-1ad3-5061-9d0c-b964c314dbad with identifier: LG10256
2026-03-29 07:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd052d56-1ad3-5061-9d0c-b964c314dbad with scrape type 2
2026-03-29 07:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd052d56-1ad3-5061-9d0c-b964c314dbad with scrape type 2
2026-03-29 07:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd052d56-1ad3-5061-9d0c-b964c314dbad, identifier: LG10256
2026-03-29 07:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd052d56-1ad3-5061-9d0c-b964c314dbad with identifier: LG10256
2026-03-29 07:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd052d56-1ad3-5061-9d0c-b964c314dbad with identifier: LG10256
2026-03-29 07:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd052d56-1ad3-5061-9d0c-b964c314dbad with identifier: LG10256 to the API
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:34:06Z',
'fuel_type': 'petrol',
'id': 'fd052d56-1ad3-5061-9d0c-b964c314dbad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG10256',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 147978,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-28',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-29 07:30:18 [auto1.de] INFO: Saving data for LG10256: {'auction_closing_time': 1774884846.0, 'created_time': 1773830414.578552, 'last_price_update_time': 1774769418.691091}
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG10256') HTTP/1.1" 204 0
2026-03-29 07:30:18 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-29 07:30:18 [auto1.de] INFO: Scrape type for KK73289: 2
2026-03-29 07:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f5350c-f51b-596d-971e-7f3b349f21ef with identifier: KK73289
2026-03-29 07:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f5350c-f51b-596d-971e-7f3b349f21ef with scrape type 2
2026-03-29 07:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f5350c-f51b-596d-971e-7f3b349f21ef with scrape type 2
2026-03-29 07:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5f5350c-f51b-596d-971e-7f3b349f21ef, identifier: KK73289
2026-03-29 07:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5f5350c-f51b-596d-971e-7f3b349f21ef with identifier: KK73289
2026-03-29 07:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5f5350c-f51b-596d-971e-7f3b349f21ef with identifier: KK73289
2026-03-29 07:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5f5350c-f51b-596d-971e-7f3b349f21ef with identifier: KK73289 to the API
2026-03-29 07:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 612,
'expiration_date': '2026-03-30T15:50:58Z',
'fuel_type': 'petrol',
'id': 'd5f5350c-f51b-596d-971e-7f3b349f21ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK73289',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 148297,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-27',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 63 AMG L 4Matic',
'transmission': 'automatic',
'trim': 'L 4Matic',
'year': 2018}
2026-03-29 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-29 07:30:19 [auto1.de] INFO: Saving data for KK73289: {'auction_closing_time': 1774885858.0, 'created_time': 1774291935.452467, 'last_price_update_time': 1774769419.969256}
2026-03-29 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK73289') HTTP/1.1" 204 0
2026-03-29 07:30:19 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-29 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-29 07:30:20 [auto1.de] INFO: Scrape type for LS49952: 2
2026-03-29 07:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-29 07:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be26a880-c042-5db3-a95f-1b22f9a4e33d with scrape type 2
2026-03-29 07:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be26a880-c042-5db3-a95f-1b22f9a4e33d with scrape type 2
2026-03-29 07:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be26a880-c042-5db3-a95f-1b22f9a4e33d, identifier: LS49952
2026-03-29 07:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 07:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952
2026-03-29 07:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be26a880-c042-5db3-a95f-1b22f9a4e33d with identifier: LS49952 to the API
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:17:16Z',
'fuel_type': 'diesel',
'id': 'be26a880-c042-5db3-a95f-1b22f9a4e33d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS49952',
'listing': 'auction',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 144757,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-24',
'seller_name': None,
'title': 'Opel Grandland X 1.5 CDTI INNOVATION',
'transmission': 'manual',
'trim': 'INNOVATION',
'year': 2018}
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-29 07:30:20 [auto1.de] INFO: Saving data for LS49952: {'auction_closing_time': 1774883836.0, 'created_time': 1773307326.541621, 'last_price_update_time': 1774769420.590254}
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS49952') HTTP/1.1" 204 0
2026-03-29 07:30:20 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-29 07:30:20 [auto1.de] INFO: Scrape type for EN74445: 2
2026-03-29 07:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-29 07:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with scrape type 2
2026-03-29 07:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with scrape type 2
2026-03-29 07:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82, identifier: EN74445
2026-03-29 07:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-29 07:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445
2026-03-29 07:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f06bf916-8ec8-5711-b2a5-0d9f6da2dd82 with identifier: EN74445 to the API
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:37:29Z',
'fuel_type': 'diesel',
'id': 'f06bf916-8ec8-5711-b2a5-0d9f6da2dd82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN74445',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 117852,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-26',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-29 07:30:21 [auto1.de] INFO: Saving data for EN74445: {'auction_closing_time': 1774885049.0, 'created_time': 1773225163.627787, 'last_price_update_time': 1774769421.107004}
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN74445') HTTP/1.1" 204 0
2026-03-29 07:30:21 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-29 07:30:21 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-29 07:30:21 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-29 07:30:21 [auto1.de] INFO: Scrape type for YL95361: 2
2026-03-29 07:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with identifier: YL95361
2026-03-29 07:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with scrape type 2
2026-03-29 07:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with scrape type 2
2026-03-29 07:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f, identifier: YL95361
2026-03-29 07:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with identifier: YL95361
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 07:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with identifier: YL95361
2026-03-29 07:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f with identifier: YL95361 to the API
2026-03-29 07:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:42:48Z',
'fuel_type': 'diesel',
'id': 'e15e6498-3ee0-522d-b4fc-e8c3a1cd1c4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL95361',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Kombi',
'odometer': 100009,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-12',
'seller_name': None,
'title': 'Volkswagen T6 Kombi 2.0 TDI lang 4Motion',
'transmission': 'automatic',
'trim': 'lang 4Motion',
'year': 2017}
2026-03-29 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-29 07:30:22 [auto1.de] INFO: Saving data for YL95361: {'auction_closing_time': 1774885368.0, 'created_time': 1774377998.661065, 'last_price_update_time': 1774769422.733105}
2026-03-29 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL95361') HTTP/1.1" 204 0
2026-03-29 07:30:22 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-29 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-29 07:30:22 [auto1.de] INFO: Scrape type for DZ61875: 2
2026-03-29 07:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4df38646-7b80-5690-bdfc-b933801c0246 with identifier: DZ61875
2026-03-29 07:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4df38646-7b80-5690-bdfc-b933801c0246 with scrape type 2
2026-03-29 07:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4df38646-7b80-5690-bdfc-b933801c0246 with scrape type 2
2026-03-29 07:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4df38646-7b80-5690-bdfc-b933801c0246, identifier: DZ61875
2026-03-29 07:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4df38646-7b80-5690-bdfc-b933801c0246 with identifier: DZ61875
2026-03-29 07:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4df38646-7b80-5690-bdfc-b933801c0246 with identifier: DZ61875
2026-03-29 07:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4df38646-7b80-5690-bdfc-b933801c0246 with identifier: DZ61875 to the API
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:34:49Z',
'fuel_type': 'diesel',
'id': '4df38646-7b80-5690-bdfc-b933801c0246',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ61875',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 99983,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-03',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency 2Style',
'transmission': 'manual',
'trim': 'BlueEfficiency 2Style',
'year': 2014}
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-29 07:30:23 [auto1.de] INFO: Saving data for DZ61875: {'auction_closing_time': 1774884889.0, 'created_time': 1773302969.669954, 'last_price_update_time': 1774769423.443627}
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ61875') HTTP/1.1" 204 0
2026-03-29 07:30:23 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-29 07:30:23 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-29 07:30:23 [auto1.de] INFO: Scrape type for NC06801: 2
2026-03-29 07:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-29 07:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97036840-b34f-5d4b-8251-e5a327b3ad4f with scrape type 2
2026-03-29 07:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97036840-b34f-5d4b-8251-e5a327b3ad4f with scrape type 2
2026-03-29 07:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97036840-b34f-5d4b-8251-e5a327b3ad4f, identifier: NC06801
2026-03-29 07:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 07:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801
2026-03-29 07:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97036840-b34f-5d4b-8251-e5a327b3ad4f with identifier: NC06801 to the API
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:07:00Z',
'fuel_type': 'petrol',
'id': '97036840-b34f-5d4b-8251-e5a327b3ad4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC06801',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 129074,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-05',
'seller_name': None,
'title': 'Kia Venga 1.4 Dream Team',
'transmission': 'manual',
'trim': 'Dream Team',
'year': 2014}
2026-03-29 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-29 07:30:24 [auto1.de] INFO: Saving data for NC06801: {'auction_closing_time': 1774883220.0, 'created_time': 1773228965.411348, 'last_price_update_time': 1774769424.096114}
2026-03-29 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC06801') HTTP/1.1" 204 0
2026-03-29 07:30:24 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-29 07:30:24 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-29 07:30:24 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-29 07:30:24 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-29 07:30:24 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-29 07:30:24 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-29 07:30:24 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-29 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-29 07:30:24 [auto1.de] INFO: Scrape type for SF55933: 2
2026-03-29 07:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f444f1-b6ae-5dd8-943f-49917b36f542 with identifier: SF55933
2026-03-29 07:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f444f1-b6ae-5dd8-943f-49917b36f542 with scrape type 2
2026-03-29 07:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4f444f1-b6ae-5dd8-943f-49917b36f542 with scrape type 2
2026-03-29 07:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4f444f1-b6ae-5dd8-943f-49917b36f542, identifier: SF55933
2026-03-29 07:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4f444f1-b6ae-5dd8-943f-49917b36f542 with identifier: SF55933
2026-03-29 07:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4f444f1-b6ae-5dd8-943f-49917b36f542 with identifier: SF55933
2026-03-29 07:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4f444f1-b6ae-5dd8-943f-49917b36f542 with identifier: SF55933 to the API
2026-03-29 07:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:06:03Z',
'fuel_type': 'diesel',
'id': 'd4f444f1-b6ae-5dd8-943f-49917b36f542',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF55933',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 123247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-22',
'seller_name': None,
'title': 'Audi Q7 50 TDI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-29 07:30:25 [auto1.de] INFO: Saving data for SF55933: {'auction_closing_time': 1774883163.0, 'created_time': 1773135783.408842, 'last_price_update_time': 1774769425.31746}
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF55933') HTTP/1.1" 204 0
2026-03-29 07:30:25 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-29 07:30:25 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-29 07:30:25 [auto1.de] INFO: Scrape type for RY86630: 2
2026-03-29 07:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb0120e-2904-5495-8568-4f718e1ac06c with identifier: RY86630
2026-03-29 07:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb0120e-2904-5495-8568-4f718e1ac06c with scrape type 2
2026-03-29 07:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb0120e-2904-5495-8568-4f718e1ac06c with scrape type 2
2026-03-29 07:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bb0120e-2904-5495-8568-4f718e1ac06c, identifier: RY86630
2026-03-29 07:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bb0120e-2904-5495-8568-4f718e1ac06c with identifier: RY86630
2026-03-29 07:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bb0120e-2904-5495-8568-4f718e1ac06c with identifier: RY86630
2026-03-29 07:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bb0120e-2904-5495-8568-4f718e1ac06c with identifier: RY86630 to the API
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:28:30Z',
'fuel_type': 'diesel',
'id': '1bb0120e-2904-5495-8568-4f718e1ac06c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY86630',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 119503,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-27',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-29 07:30:25 [auto1.de] INFO: Saving data for RY86630: {'auction_closing_time': 1774884510.0, 'created_time': 1773229651.733172, 'last_price_update_time': 1774769425.891341}
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY86630') HTTP/1.1" 204 0
2026-03-29 07:30:26 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-29 07:30:26 [auto1.de] INFO: Scrape type for CU91826: 2
2026-03-29 07:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef2603cd-d54b-52b7-ac4c-22502a862bd2 with identifier: CU91826
2026-03-29 07:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2603cd-d54b-52b7-ac4c-22502a862bd2 with scrape type 2
2026-03-29 07:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef2603cd-d54b-52b7-ac4c-22502a862bd2 with scrape type 2
2026-03-29 07:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef2603cd-d54b-52b7-ac4c-22502a862bd2, identifier: CU91826
2026-03-29 07:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef2603cd-d54b-52b7-ac4c-22502a862bd2 with identifier: CU91826
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 07:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef2603cd-d54b-52b7-ac4c-22502a862bd2 with identifier: CU91826
2026-03-29 07:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef2603cd-d54b-52b7-ac4c-22502a862bd2 with identifier: CU91826 to the API
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:09:15Z',
'fuel_type': 'diesel',
'id': 'ef2603cd-d54b-52b7-ac4c-22502a862bd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU91826',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 167349,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-29',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2015}
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-29 07:30:26 [auto1.de] INFO: Saving data for CU91826: {'auction_closing_time': 1774883355.0, 'created_time': 1773830793.207047, 'last_price_update_time': 1774769426.685251}
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU91826') HTTP/1.1" 204 0
2026-03-29 07:30:26 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-29 07:30:26 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-29 07:30:26 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-29 07:30:26 [auto1.de] INFO: Scrape type for YY17846: 2
2026-03-29 07:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 082efb13-27db-5a4b-9dfc-f34bc1847156 with identifier: YY17846
2026-03-29 07:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 082efb13-27db-5a4b-9dfc-f34bc1847156 with scrape type 2
2026-03-29 07:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 082efb13-27db-5a4b-9dfc-f34bc1847156 with scrape type 2
2026-03-29 07:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 082efb13-27db-5a4b-9dfc-f34bc1847156, identifier: YY17846
2026-03-29 07:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 082efb13-27db-5a4b-9dfc-f34bc1847156 with identifier: YY17846
2026-03-29 07:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 082efb13-27db-5a4b-9dfc-f34bc1847156 with identifier: YY17846
2026-03-29 07:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 082efb13-27db-5a4b-9dfc-f34bc1847156 with identifier: YY17846 to the API
2026-03-29 07:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:29:26Z',
'fuel_type': 'diesel',
'id': '082efb13-27db-5a4b-9dfc-f34bc1847156',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY17846',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 80715,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-21',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueTEC Elegance',
'transmission': 'automatic',
'trim': 'BlueTEC Elegance',
'year': 2015}
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-29 07:30:28 [auto1.de] INFO: Saving data for YY17846: {'auction_closing_time': 1774884566.0, 'created_time': 1773229136.910689, 'last_price_update_time': 1774769428.07312}
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY17846') HTTP/1.1" 204 0
2026-03-29 07:30:28 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-29 07:30:28 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-29 07:30:28 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-29 07:30:28 [auto1.de] INFO: Scrape type for CG73719: 2
2026-03-29 07:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e708035-a7f3-56ca-9400-b525d0518c74 with identifier: CG73719
2026-03-29 07:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e708035-a7f3-56ca-9400-b525d0518c74 with scrape type 2
2026-03-29 07:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e708035-a7f3-56ca-9400-b525d0518c74 with scrape type 2
2026-03-29 07:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e708035-a7f3-56ca-9400-b525d0518c74, identifier: CG73719
2026-03-29 07:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e708035-a7f3-56ca-9400-b525d0518c74 with identifier: CG73719
2026-03-29 07:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e708035-a7f3-56ca-9400-b525d0518c74 with identifier: CG73719
2026-03-29 07:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e708035-a7f3-56ca-9400-b525d0518c74 with identifier: CG73719 to the API
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:45Z',
'fuel_type': 'petrol',
'id': '2e708035-a7f3-56ca-9400-b525d0518c74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG73719',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 49535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-12',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Sports-Line AWD',
'transmission': 'automatic',
'trim': 'Sports-Line AWD',
'year': 2016}
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-29 07:30:28 [auto1.de] INFO: Saving data for CG73719: {'auction_closing_time': 1774883205.0, 'created_time': 1773224876.898418, 'last_price_update_time': 1774769428.534623}
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG73719') HTTP/1.1" 204 0
2026-03-29 07:30:28 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-29 07:30:28 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-29 07:30:28 [auto1.de] INFO: Scrape type for NB79280: 2
2026-03-29 07:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce20d58-9340-5ced-afa2-899cad433423 with identifier: NB79280
2026-03-29 07:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce20d58-9340-5ced-afa2-899cad433423 with scrape type 2
2026-03-29 07:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ce20d58-9340-5ced-afa2-899cad433423 with scrape type 2
2026-03-29 07:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ce20d58-9340-5ced-afa2-899cad433423, identifier: NB79280
2026-03-29 07:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ce20d58-9340-5ced-afa2-899cad433423 with identifier: NB79280
2026-03-29 07:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ce20d58-9340-5ced-afa2-899cad433423 with identifier: NB79280
2026-03-29 07:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ce20d58-9340-5ced-afa2-899cad433423 with identifier: NB79280 to the API
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:52:50Z',
'fuel_type': 'petrol',
'id': '8ce20d58-9340-5ced-afa2-899cad433423',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB79280',
'listing': 'auction',
'make': 'Audi',
'model': 'S5 Sportback',
'odometer': 143552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-15',
'seller_name': None,
'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-29 07:30:28 [auto1.de] INFO: Saving data for NB79280: {'auction_closing_time': 1774885970.0, 'created_time': 1773830423.296158, 'last_price_update_time': 1774769428.992205}
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB79280') HTTP/1.1" 204 0
2026-03-29 07:30:29 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-29 07:30:29 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-29 07:30:29 [auto1.de] INFO: Scrape type for XK62781: 2
2026-03-29 07:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b149f4-2f34-5747-a438-460d91bdcb09 with identifier: XK62781
2026-03-29 07:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b149f4-2f34-5747-a438-460d91bdcb09 with scrape type 2
2026-03-29 07:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b149f4-2f34-5747-a438-460d91bdcb09 with scrape type 2
2026-03-29 07:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50b149f4-2f34-5747-a438-460d91bdcb09, identifier: XK62781
2026-03-29 07:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50b149f4-2f34-5747-a438-460d91bdcb09 with identifier: XK62781
2026-03-29 07:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50b149f4-2f34-5747-a438-460d91bdcb09 with identifier: XK62781
2026-03-29 07:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50b149f4-2f34-5747-a438-460d91bdcb09 with identifier: XK62781 to the API
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:22:03Z',
'fuel_type': 'diesel',
'id': '50b149f4-2f34-5747-a438-460d91bdcb09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK62781',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 52451,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-17',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Energy Rapid Extra',
'transmission': 'manual',
'trim': 'Rapid Extra',
'year': 2017}
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-29 07:30:29 [auto1.de] INFO: Saving data for XK62781: {'auction_closing_time': 1774884123.0, 'created_time': 1773227599.830867, 'last_price_update_time': 1774769429.486643}
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK62781') HTTP/1.1" 204 0
2026-03-29 07:30:29 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-29 07:30:29 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-29 07:30:29 [auto1.de] INFO: Scrape type for YF68653: 2
2026-03-29 07:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b758e719-b895-55ce-a668-59666ee125af with identifier: YF68653
2026-03-29 07:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b758e719-b895-55ce-a668-59666ee125af with scrape type 2
2026-03-29 07:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b758e719-b895-55ce-a668-59666ee125af with scrape type 2
2026-03-29 07:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b758e719-b895-55ce-a668-59666ee125af, identifier: YF68653
2026-03-29 07:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b758e719-b895-55ce-a668-59666ee125af with identifier: YF68653
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 07:30:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b758e719-b895-55ce-a668-59666ee125af with identifier: YF68653
2026-03-29 07:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b758e719-b895-55ce-a668-59666ee125af with identifier: YF68653 to the API
2026-03-29 07:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:47:18Z',
'fuel_type': 'hybrid',
'id': 'b758e719-b895-55ce-a668-59666ee125af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF68653',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5 Sportback',
'odometer': 24490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-27',
'seller_name': None,
'title': 'Audi Q5 Sportback 55 TFSIe quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-03-29 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-29 07:30:30 [auto1.de] INFO: Saving data for YF68653: {'auction_closing_time': 1774885638.0, 'created_time': 1773228278.83062, 'last_price_update_time': 1774769430.820701}
2026-03-29 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF68653') HTTP/1.1" 204 0
2026-03-29 07:30:30 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-29 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-29 07:30:30 [auto1.de] INFO: Scrape type for TF22102: 2
2026-03-29 07:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19136e81-3df1-5e27-9a41-d0b687c90d68 with identifier: TF22102
2026-03-29 07:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19136e81-3df1-5e27-9a41-d0b687c90d68 with scrape type 2
2026-03-29 07:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19136e81-3df1-5e27-9a41-d0b687c90d68 with scrape type 2
2026-03-29 07:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19136e81-3df1-5e27-9a41-d0b687c90d68, identifier: TF22102
2026-03-29 07:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19136e81-3df1-5e27-9a41-d0b687c90d68 with identifier: TF22102
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 07:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19136e81-3df1-5e27-9a41-d0b687c90d68 with identifier: TF22102
2026-03-29 07:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19136e81-3df1-5e27-9a41-d0b687c90d68 with identifier: TF22102 to the API
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:57Z',
'fuel_type': 'diesel',
'id': '19136e81-3df1-5e27-9a41-d0b687c90d68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF22102',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 89956,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-23',
'seller_name': None,
'title': 'Land Rover Evoque D150 Mild-Hybrid SE',
'transmission': 'automatic',
'trim': 'SE',
'year': 2019}
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-29 07:30:31 [auto1.de] INFO: Saving data for TF22102: {'auction_closing_time': 1774882857.0, 'created_time': 1774291800.037167, 'last_price_update_time': 1774769431.749391}
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF22102') HTTP/1.1" 204 0
2026-03-29 07:30:31 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 6221 | hits on page: 40
2026-03-29 07:30:31 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-29 07:30:31 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-29 07:30:31 [auto1.de] INFO: Scrape type for FG94497: 2
2026-03-29 07:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-29 07:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with scrape type 2
2026-03-29 07:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with scrape type 2
2026-03-29 07:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e, identifier: FG94497
2026-03-29 07:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-29 07:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497
2026-03-29 07:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7c6980b-7cb1-5b6f-846e-03dca8c11a0e with identifier: FG94497 to the API
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:34:40Z',
'fuel_type': 'diesel',
'id': 'b7c6980b-7cb1-5b6f-846e-03dca8c11a0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG94497',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 311006,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-01',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2014}
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-29 07:30:32 [auto1.de] INFO: Saving data for FG94497: {'auction_closing_time': 1774884880.0, 'created_time': 1773226162.563917, 'last_price_update_time': 1774769432.27196}
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG94497') HTTP/1.1" 204 0
2026-03-29 07:30:32 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-29 07:30:32 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-29 07:30:32 [auto1.de] INFO: Scrape type for YV77496: 2
2026-03-29 07:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf17382-e942-5eb8-b7f7-2dbf1531b4ea with identifier: YV77496
2026-03-29 07:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf17382-e942-5eb8-b7f7-2dbf1531b4ea with scrape type 2
2026-03-29 07:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caf17382-e942-5eb8-b7f7-2dbf1531b4ea with scrape type 2
2026-03-29 07:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caf17382-e942-5eb8-b7f7-2dbf1531b4ea, identifier: YV77496
2026-03-29 07:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caf17382-e942-5eb8-b7f7-2dbf1531b4ea with identifier: YV77496
2026-03-29 07:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caf17382-e942-5eb8-b7f7-2dbf1531b4ea with identifier: YV77496
2026-03-29 07:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caf17382-e942-5eb8-b7f7-2dbf1531b4ea with identifier: YV77496 to the API
2026-03-29 07:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:48:37Z',
'fuel_type': 'diesel',
'id': 'caf17382-e942-5eb8-b7f7-2dbf1531b4ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV77496',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 160727,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-20',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2019}
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-29 07:30:33 [auto1.de] INFO: Saving data for YV77496: {'auction_closing_time': 1774885717.0, 'created_time': 1774378048.104266, 'last_price_update_time': 1774769433.389924}
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV77496') HTTP/1.1" 204 0
2026-03-29 07:30:33 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-29 07:30:33 [auto1.de] INFO: Scrape type for UP55946: 2
2026-03-29 07:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-29 07:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de367412-b564-5c37-9ef9-f93836afcfd0 with scrape type 2
2026-03-29 07:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de367412-b564-5c37-9ef9-f93836afcfd0 with scrape type 2
2026-03-29 07:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de367412-b564-5c37-9ef9-f93836afcfd0, identifier: UP55946
2026-03-29 07:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-29 07:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946
2026-03-29 07:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de367412-b564-5c37-9ef9-f93836afcfd0 with identifier: UP55946 to the API
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:06:53Z',
'fuel_type': 'diesel',
'id': 'de367412-b564-5c37-9ef9-f93836afcfd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP55946',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 133255,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-26',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L1H1 Ka 2,8t Ecoline',
'transmission': 'manual',
'trim': 'L1H1 Ka 2,8t Ecoline',
'year': 2015}
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-29 07:30:33 [auto1.de] INFO: Saving data for UP55946: {'auction_closing_time': 1774883213.0, 'created_time': 1773303063.986486, 'last_price_update_time': 1774769433.834909}
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP55946') HTTP/1.1" 204 0
2026-03-29 07:30:33 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-29 07:30:33 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-29 07:30:33 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-29 07:30:33 [auto1.de] INFO: Scrape type for NJ52204: 2
2026-03-29 07:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with identifier: NJ52204
2026-03-29 07:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with scrape type 2
2026-03-29 07:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with scrape type 2
2026-03-29 07:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27f49ffd-f9a0-55b1-9010-c0cd79a41753, identifier: NJ52204
2026-03-29 07:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with identifier: NJ52204
2026-03-29 07:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with identifier: NJ52204
2026-03-29 07:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27f49ffd-f9a0-55b1-9010-c0cd79a41753 with identifier: NJ52204 to the API
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:13Z',
'fuel_type': 'petrol',
'id': '27f49ffd-f9a0-55b1-9010-c0cd79a41753',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ52204',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 128640,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-16',
'seller_name': None,
'title': 'Volkswagen Passat 1.5 TSI ACT Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Saving data for NJ52204: {'auction_closing_time': 1774884133.0, 'created_time': 1773741436.549641, 'last_price_update_time': 1774769434.346599}
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ52204') HTTP/1.1" 204 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for YN38539: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for CG08693: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for LG10256: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for LS49952: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for EN74445: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for YL95361: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for RY86630: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for CU91826: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for YY17846: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-29 07:30:34 [auto1.de] INFO: Scrape type for NB79280: 0
2026-03-29 07:30:34 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-29 07:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:30:42 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 6226 | hits on page: 40
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Scrape type for NB79280: 0
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Scrape type for TF22102: 0
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Scrape type for FG94497: 0
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Scrape type for HE99483: 2
2026-03-29 07:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a849d2c-bac0-5add-9427-cfdedd37481f with identifier: HE99483
2026-03-29 07:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a849d2c-bac0-5add-9427-cfdedd37481f with scrape type 2
2026-03-29 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a849d2c-bac0-5add-9427-cfdedd37481f with scrape type 2
2026-03-29 07:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a849d2c-bac0-5add-9427-cfdedd37481f, identifier: HE99483
2026-03-29 07:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a849d2c-bac0-5add-9427-cfdedd37481f with identifier: HE99483
2026-03-29 07:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a849d2c-bac0-5add-9427-cfdedd37481f with identifier: HE99483
2026-03-29 07:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a849d2c-bac0-5add-9427-cfdedd37481f with identifier: HE99483 to the API
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:24:35Z',
'fuel_type': 'diesel',
'id': '9a849d2c-bac0-5add-9427-cfdedd37481f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE99483',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 301933,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-07',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2014}
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Saving data for HE99483: {'auction_closing_time': 1774884275.0, 'created_time': 1773741534.076461, 'last_price_update_time': 1774769442.582441}
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE99483') HTTP/1.1" 204 0
2026-03-29 07:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:30:42 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-29 07:30:42 [auto1.de] INFO: Scrape type for LF77567: 2
2026-03-29 07:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f28314ce-1222-5e51-b084-9b8d74ca8aa7 with identifier: LF77567
2026-03-29 07:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f28314ce-1222-5e51-b084-9b8d74ca8aa7 with scrape type 2
2026-03-29 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f28314ce-1222-5e51-b084-9b8d74ca8aa7 with scrape type 2
2026-03-29 07:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f28314ce-1222-5e51-b084-9b8d74ca8aa7, identifier: LF77567
2026-03-29 07:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f28314ce-1222-5e51-b084-9b8d74ca8aa7 with identifier: LF77567
2026-03-29 07:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f28314ce-1222-5e51-b084-9b8d74ca8aa7 with identifier: LF77567
2026-03-29 07:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f28314ce-1222-5e51-b084-9b8d74ca8aa7 with identifier: LF77567 to the API
2026-03-29 07:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:27:55Z',
'fuel_type': 'diesel',
'id': 'f28314ce-1222-5e51-b084-9b8d74ca8aa7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF77567',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 132150,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-26',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi GT Line",
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2017}
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-29 07:30:43 [auto1.de] INFO: Saving data for LF77567: {'auction_closing_time': 1774884475.0, 'created_time': 1773229840.977069, 'last_price_update_time': 1774769443.12433}
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF77567') HTTP/1.1" 204 0
2026-03-29 07:30:43 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-29 07:30:43 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-29 07:30:43 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-29 07:30:43 [auto1.de] INFO: Scrape type for VJ93938: 2
2026-03-29 07:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 725c8336-0865-56b5-8774-4f334b23b962 with identifier: VJ93938
2026-03-29 07:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 725c8336-0865-56b5-8774-4f334b23b962 with scrape type 2
2026-03-29 07:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 725c8336-0865-56b5-8774-4f334b23b962 with scrape type 2
2026-03-29 07:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 725c8336-0865-56b5-8774-4f334b23b962, identifier: VJ93938
2026-03-29 07:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 725c8336-0865-56b5-8774-4f334b23b962 with identifier: VJ93938
2026-03-29 07:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 725c8336-0865-56b5-8774-4f334b23b962 with identifier: VJ93938
2026-03-29 07:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 725c8336-0865-56b5-8774-4f334b23b962 with identifier: VJ93938 to the API
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:24:24Z',
'fuel_type': 'diesel',
'id': '725c8336-0865-56b5-8774-4f334b23b962',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ93938',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 74795,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-03',
'seller_name': None,
'title': 'Audi A6 45 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2021}
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-29 07:30:43 [auto1.de] INFO: Saving data for VJ93938: {'auction_closing_time': 1774884264.0, 'created_time': 1774465753.855338, 'last_price_update_time': 1774769443.577031}
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ93938') HTTP/1.1" 204 0
2026-03-29 07:30:43 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-29 07:30:43 [auto1.de] INFO: Scrape type for AX13429: 2
2026-03-29 07:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd6c8799-a6ee-570d-842e-087d03a9198c with identifier: AX13429
2026-03-29 07:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd6c8799-a6ee-570d-842e-087d03a9198c with scrape type 2
2026-03-29 07:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd6c8799-a6ee-570d-842e-087d03a9198c with scrape type 2
2026-03-29 07:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd6c8799-a6ee-570d-842e-087d03a9198c, identifier: AX13429
2026-03-29 07:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd6c8799-a6ee-570d-842e-087d03a9198c with identifier: AX13429
2026-03-29 07:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd6c8799-a6ee-570d-842e-087d03a9198c with identifier: AX13429
2026-03-29 07:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd6c8799-a6ee-570d-842e-087d03a9198c with identifier: AX13429 to the API
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:15:41Z',
'fuel_type': 'petrol',
'id': 'cd6c8799-a6ee-570d-842e-087d03a9198c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX13429',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 115559,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-16',
'seller_name': None,
'title': 'BMW 2er 218i Gran Tourer Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2015}
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-29 07:30:44 [auto1.de] INFO: Saving data for AX13429: {'auction_closing_time': 1774883741.0, 'created_time': 1773229337.51476, 'last_price_update_time': 1774769444.013145}
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX13429') HTTP/1.1" 204 0
2026-03-29 07:30:44 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-29 07:30:44 [auto1.de] INFO: Scrape type for SD17030: 2
2026-03-29 07:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-29 07:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4dffae0-9883-5211-97e0-5506499f7ade with scrape type 2
2026-03-29 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4dffae0-9883-5211-97e0-5506499f7ade with scrape type 2
2026-03-29 07:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4dffae0-9883-5211-97e0-5506499f7ade, identifier: SD17030
2026-03-29 07:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-29 07:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030
2026-03-29 07:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4dffae0-9883-5211-97e0-5506499f7ade with identifier: SD17030 to the API
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:11:36Z',
'fuel_type': 'petrol',
'id': 'b4dffae0-9883-5211-97e0-5506499f7ade',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD17030',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 100374,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-08',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2017}
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-29 07:30:44 [auto1.de] INFO: Saving data for SD17030: {'auction_closing_time': 1774883496.0, 'created_time': 1773227290.29476, 'last_price_update_time': 1774769444.465578}
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD17030') HTTP/1.1" 204 0
2026-03-29 07:30:44 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-29 07:30:44 [auto1.de] INFO: Scrape type for JF12446: 2
2026-03-29 07:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-29 07:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e14b3722-6251-5e9d-9634-9e562d472e6d with scrape type 2
2026-03-29 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e14b3722-6251-5e9d-9634-9e562d472e6d with scrape type 2
2026-03-29 07:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e14b3722-6251-5e9d-9634-9e562d472e6d, identifier: JF12446
2026-03-29 07:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 07:30:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446
2026-03-29 07:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e14b3722-6251-5e9d-9634-9e562d472e6d with identifier: JF12446 to the API
2026-03-29 07:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:02:33Z',
'fuel_type': 'petrol',
'id': 'e14b3722-6251-5e9d-9634-9e562d472e6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF12446',
'listing': 'auction',
'make': 'Nissan',
'model': 'Note',
'odometer': 111161,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-18',
'seller_name': None,
'title': 'Nissan Note 1.6 I-Way',
'transmission': 'manual',
'trim': 'I-Way',
'year': 2012}
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-29 07:30:45 [auto1.de] INFO: Saving data for JF12446: {'auction_closing_time': 1774882953.0, 'created_time': 1773341018.13113, 'last_price_update_time': 1774769445.416608}
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF12446') HTTP/1.1" 204 0
2026-03-29 07:30:45 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-29 07:30:45 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-29 07:30:45 [auto1.de] INFO: Scrape type for NH81971: 2
2026-03-29 07:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-29 07:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d500038-8bc4-5523-abeb-64df60507f7f with scrape type 2
2026-03-29 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d500038-8bc4-5523-abeb-64df60507f7f with scrape type 2
2026-03-29 07:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d500038-8bc4-5523-abeb-64df60507f7f, identifier: NH81971
2026-03-29 07:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-29 07:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971
2026-03-29 07:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d500038-8bc4-5523-abeb-64df60507f7f with identifier: NH81971 to the API
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:04Z',
'fuel_type': 'petrol',
'id': '8d500038-8bc4-5523-abeb-64df60507f7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH81971',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 127680,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-17',
'seller_name': None,
'title': 'Seat Ateca 1.4 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2016}
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-29 07:30:45 [auto1.de] INFO: Saving data for NH81971: {'auction_closing_time': 1774885264.0, 'created_time': 1773341410.983319, 'last_price_update_time': 1774769445.842637}
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH81971') HTTP/1.1" 204 0
2026-03-29 07:30:45 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-29 07:30:45 [auto1.de] INFO: Scrape type for PU44230: 2
2026-03-29 07:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb05dc70-bc51-555c-8008-ce6b1cde573b with identifier: PU44230
2026-03-29 07:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb05dc70-bc51-555c-8008-ce6b1cde573b with scrape type 2
2026-03-29 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb05dc70-bc51-555c-8008-ce6b1cde573b with scrape type 2
2026-03-29 07:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb05dc70-bc51-555c-8008-ce6b1cde573b, identifier: PU44230
2026-03-29 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb05dc70-bc51-555c-8008-ce6b1cde573b with identifier: PU44230
2026-03-29 07:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb05dc70-bc51-555c-8008-ce6b1cde573b with identifier: PU44230
2026-03-29 07:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb05dc70-bc51-555c-8008-ce6b1cde573b with identifier: PU44230 to the API
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 421,
'expiration_date': '2026-03-30T15:00:08Z',
'fuel_type': 'petrol',
'id': 'cb05dc70-bc51-555c-8008-ce6b1cde573b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU44230',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 56560,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-26',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 45 AMG S 4Matic',
'transmission': 'automatic',
'trim': 'S 4Matic',
'year': 2020}
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-29 07:30:46 [auto1.de] INFO: Saving data for PU44230: {'auction_closing_time': 1774882808.0, 'created_time': 1773228552.677823, 'last_price_update_time': 1774769446.314709}
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU44230') HTTP/1.1" 204 0
2026-03-29 07:30:46 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-29 07:30:46 [auto1.de] INFO: Scrape type for ER86835: 2
2026-03-29 07:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with identifier: ER86835
2026-03-29 07:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with scrape type 2
2026-03-29 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with scrape type 2
2026-03-29 07:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f58e1a5-a918-54fb-a8b3-a86f6734f286, identifier: ER86835
2026-03-29 07:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with identifier: ER86835
2026-03-29 07:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with identifier: ER86835
2026-03-29 07:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f58e1a5-a918-54fb-a8b3-a86f6734f286 with identifier: ER86835 to the API
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:41:48Z',
'fuel_type': 'diesel',
'id': '3f58e1a5-a918-54fb-a8b3-a86f6734f286',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER86835',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 352466,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-29',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Conceptline',
'transmission': 'manual',
'trim': 'Conceptline',
'year': 2008}
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-29 07:30:46 [auto1.de] INFO: Saving data for ER86835: {'auction_closing_time': 1774885308.0, 'created_time': 1773132206.397327, 'last_price_update_time': 1774769446.732708}
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER86835') HTTP/1.1" 204 0
2026-03-29 07:30:46 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-29 07:30:46 [auto1.de] INFO: Scrape type for MA20018: 2
2026-03-29 07:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a06a219-147b-5967-a9c6-ccd9da789b13 with identifier: MA20018
2026-03-29 07:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a06a219-147b-5967-a9c6-ccd9da789b13 with scrape type 2
2026-03-29 07:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a06a219-147b-5967-a9c6-ccd9da789b13 with scrape type 2
2026-03-29 07:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a06a219-147b-5967-a9c6-ccd9da789b13, identifier: MA20018
2026-03-29 07:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a06a219-147b-5967-a9c6-ccd9da789b13 with identifier: MA20018
2026-03-29 07:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a06a219-147b-5967-a9c6-ccd9da789b13 with identifier: MA20018
2026-03-29 07:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a06a219-147b-5967-a9c6-ccd9da789b13 with identifier: MA20018 to the API
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:37:52Z',
'fuel_type': 'petrol',
'id': '8a06a219-147b-5967-a9c6-ccd9da789b13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA20018',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 79157,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-22',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2018}
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-29 07:30:47 [auto1.de] INFO: Saving data for MA20018: {'auction_closing_time': 1774885072.0, 'created_time': 1773343854.910449, 'last_price_update_time': 1774769447.303003}
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA20018') HTTP/1.1" 204 0
2026-03-29 07:30:47 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 6226 | hits on page: 40
2026-03-29 07:30:47 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU19428%27 HTTP/1.1" 200 None
2026-03-29 07:30:47 [auto1.de] INFO: Scrape type for SU19428: 2
2026-03-29 07:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with identifier: SU19428
2026-03-29 07:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with scrape type 2
2026-03-29 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with scrape type 2
2026-03-29 07:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26ab60f7-e878-506e-bc81-c8759dc0e5a4, identifier: SU19428
2026-03-29 07:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with identifier: SU19428
2026-03-29 07:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with identifier: SU19428
2026-03-29 07:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26ab60f7-e878-506e-bc81-c8759dc0e5a4 with identifier: SU19428 to the API
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:42:17Z',
'fuel_type': 'diesel',
'id': '26ab60f7-e878-506e-bc81-c8759dc0e5a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU19428',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 291746,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-09',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion BlueMotion Tech',
'year': 2012}
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU19428%27 HTTP/1.1" 200 None
2026-03-29 07:30:47 [auto1.de] INFO: Saving data for SU19428: {'auction_closing_time': 1774885337.0, 'created_time': 1773226588.392887, 'last_price_update_time': 1774769447.766343}
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU19428') HTTP/1.1" 204 0
2026-03-29 07:30:47 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-29 07:30:47 [auto1.de] INFO: Scrape type for ZP65093: 2
2026-03-29 07:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-29 07:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a02073-424e-5eb9-bbb7-bb8bd0142eba with scrape type 2
2026-03-29 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a02073-424e-5eb9-bbb7-bb8bd0142eba with scrape type 2
2026-03-29 07:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a02073-424e-5eb9-bbb7-bb8bd0142eba, identifier: ZP65093
2026-03-29 07:30:47 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-29 07:30:47 [auto1.de] INFO: Scrape type for UW74525: 2
2026-03-29 07:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f4322f6-c901-5dcf-808a-f9e65a38b913 with identifier: UW74525
2026-03-29 07:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f4322f6-c901-5dcf-808a-f9e65a38b913 with scrape type 2
2026-03-29 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f4322f6-c901-5dcf-808a-f9e65a38b913 with scrape type 2
2026-03-29 07:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f4322f6-c901-5dcf-808a-f9e65a38b913, identifier: UW74525
2026-03-29 07:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-29 07:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093
2026-03-29 07:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a02073-424e-5eb9-bbb7-bb8bd0142eba with identifier: ZP65093 to the API
2026-03-29 07:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:41:52Z',
'fuel_type': 'petrol',
'id': '40a02073-424e-5eb9-bbb7-bb8bd0142eba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP65093',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 156109,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-25',
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2013}
2026-03-29 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-29 07:30:48 [auto1.de] INFO: Saving data for ZP65093: {'auction_closing_time': 1774885312.0, 'created_time': 1773227525.60467, 'last_price_update_time': 1774769448.309347}
2026-03-29 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP65093') HTTP/1.1" 204 0
2026-03-29 07:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f4322f6-c901-5dcf-808a-f9e65a38b913 with identifier: UW74525
2026-03-29 07:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f4322f6-c901-5dcf-808a-f9e65a38b913 with identifier: UW74525
2026-03-29 07:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f4322f6-c901-5dcf-808a-f9e65a38b913 with identifier: UW74525 to the API
2026-03-29 07:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:14:21Z',
'fuel_type': 'petrol',
'id': '7f4322f6-c901-5dcf-808a-f9e65a38b913',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW74525',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 31408,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-11',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2024}
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-29 07:30:49 [auto1.de] INFO: Saving data for UW74525: {'auction_closing_time': 1774883661.0, 'created_time': 1773305938.614559, 'last_price_update_time': 1774769449.42879}
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW74525') HTTP/1.1" 204 0
2026-03-29 07:30:49 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN49232%27 HTTP/1.1" 200 None
2026-03-29 07:30:49 [auto1.de] INFO: Scrape type for JN49232: 2
2026-03-29 07:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9811c288-0d36-5230-891e-e6522355b169 with identifier: JN49232
2026-03-29 07:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9811c288-0d36-5230-891e-e6522355b169 with scrape type 2
2026-03-29 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9811c288-0d36-5230-891e-e6522355b169 with scrape type 2
2026-03-29 07:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9811c288-0d36-5230-891e-e6522355b169, identifier: JN49232
2026-03-29 07:30:49 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-29 07:30:49 [auto1.de] INFO: Scrape type for CP06642: 2
2026-03-29 07:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-29 07:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with scrape type 2
2026-03-29 07:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with scrape type 2
2026-03-29 07:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b, identifier: CP06642
2026-03-29 07:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9811c288-0d36-5230-891e-e6522355b169 with identifier: JN49232
2026-03-29 07:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9811c288-0d36-5230-891e-e6522355b169 with identifier: JN49232
2026-03-29 07:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9811c288-0d36-5230-891e-e6522355b169 with identifier: JN49232 to the API
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:49:58Z',
'fuel_type': 'diesel',
'id': '9811c288-0d36-5230-891e-e6522355b169',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN49232',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 119768,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-17',
'seller_name': None,
'title': 'BMW 1er 120d Metropolitan',
'transmission': 'manual',
'trim': 'Metropolitan',
'year': 2019}
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN49232%27 HTTP/1.1" 200 None
2026-03-29 07:30:49 [auto1.de] INFO: Saving data for JN49232: {'auction_closing_time': 1774885798.0, 'created_time': 1773305499.655783, 'last_price_update_time': 1774769449.992396}
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN49232') HTTP/1.1" 204 0
2026-03-29 07:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-29 07:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642
2026-03-29 07:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14486fe4-9ea4-5ea5-9b46-ebb33e56808b with identifier: CP06642 to the API
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:21:02Z',
'fuel_type': 'petrol',
'id': '14486fe4-9ea4-5ea5-9b46-ebb33e56808b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP06642',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 56773,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-25',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-29 07:30:50 [auto1.de] INFO: Saving data for CP06642: {'auction_closing_time': 1774884062.0, 'created_time': 1773132241.051774, 'last_price_update_time': 1774769450.3134}
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP06642') HTTP/1.1" 204 0
2026-03-29 07:30:50 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-29 07:30:50 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-29 07:30:50 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-29 07:30:50 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-29 07:30:50 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-29 07:30:50 [auto1.de] INFO: Scrape type for ZT07846: 2
2026-03-29 07:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with identifier: ZT07846
2026-03-29 07:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with scrape type 2
2026-03-29 07:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with scrape type 2
2026-03-29 07:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3, identifier: ZT07846
2026-03-29 07:30:50 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-29 07:30:50 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX40073%27 HTTP/1.1" 200 None
2026-03-29 07:30:50 [auto1.de] INFO: Scrape type for YX40073: 2
2026-03-29 07:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 054c889c-dd10-53ce-8b84-b623175186ec with identifier: YX40073
2026-03-29 07:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 054c889c-dd10-53ce-8b84-b623175186ec with scrape type 2
2026-03-29 07:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 054c889c-dd10-53ce-8b84-b623175186ec with scrape type 2
2026-03-29 07:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 054c889c-dd10-53ce-8b84-b623175186ec, identifier: YX40073
2026-03-29 07:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with identifier: ZT07846
2026-03-29 07:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with identifier: ZT07846
2026-03-29 07:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74c95dc3-0af5-54b5-ba2d-d654d13de3b3 with identifier: ZT07846 to the API
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:30:31Z',
'fuel_type': 'diesel',
'id': '74c95dc3-0af5-54b5-ba2d-d654d13de3b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT07846',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 148176,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-17',
'seller_name': None,
'title': 'Audi Q5 40 TDI quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2019}
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-29 07:30:50 [auto1.de] INFO: Saving data for ZT07846: {'auction_closing_time': 1774884631.0, 'created_time': 1773859080.24702, 'last_price_update_time': 1774769450.871169}
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT07846') HTTP/1.1" 204 0
2026-03-29 07:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 054c889c-dd10-53ce-8b84-b623175186ec with identifier: YX40073
2026-03-29 07:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 054c889c-dd10-53ce-8b84-b623175186ec with identifier: YX40073
2026-03-29 07:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 054c889c-dd10-53ce-8b84-b623175186ec with identifier: YX40073 to the API
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:37:47Z',
'fuel_type': 'petrol',
'id': '054c889c-dd10-53ce-8b84-b623175186ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX40073',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 74442,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-13',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2022}
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX40073%27 HTTP/1.1" 200 None
2026-03-29 07:30:51 [auto1.de] INFO: Saving data for YX40073: {'auction_closing_time': 1774885067.0, 'created_time': 1774378012.791862, 'last_price_update_time': 1774769451.348882}
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX40073') HTTP/1.1" 204 0
2026-03-29 07:30:51 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-29 07:30:51 [auto1.de] INFO: Scrape type for WG75781: 2
2026-03-29 07:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-29 07:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with scrape type 2
2026-03-29 07:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with scrape type 2
2026-03-29 07:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f, identifier: WG75781
2026-03-29 07:30:51 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-29 07:30:51 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-29 07:30:51 [auto1.de] INFO: Scrape type for LC05735: 2
2026-03-29 07:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-29 07:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with scrape type 2
2026-03-29 07:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with scrape type 2
2026-03-29 07:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 515d0088-dc9f-5bc2-be38-cdc35e754cd5, identifier: LC05735
2026-03-29 07:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-29 07:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781
2026-03-29 07:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f with identifier: WG75781 to the API
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:33:50Z',
'fuel_type': 'diesel',
'id': 'cfe8c7fd-ce89-5e94-9d16-b4bc1a1c521f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG75781',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 41915,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-18',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-29 07:30:51 [auto1.de] INFO: Saving data for WG75781: {'auction_closing_time': 1774884830.0, 'created_time': 1773344911.66281, 'last_price_update_time': 1774769451.876564}
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG75781') HTTP/1.1" 204 0
2026-03-29 07:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-29 07:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735
2026-03-29 07:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 515d0088-dc9f-5bc2-be38-cdc35e754cd5 with identifier: LC05735 to the API
2026-03-29 07:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:21:31Z',
'fuel_type': 'petrol',
'id': '515d0088-dc9f-5bc2-be38-cdc35e754cd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC05735',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 19216,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-17',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Mild-Hybrid AMG '
'Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2023}
2026-03-29 07:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-29 07:30:52 [auto1.de] INFO: Saving data for LC05735: {'auction_closing_time': 1774884091.0, 'created_time': 1773307137.637304, 'last_price_update_time': 1774769452.91627}
2026-03-29 07:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC05735') HTTP/1.1" 204 0
2026-03-29 07:30:52 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-29 07:30:52 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-29 07:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-29 07:30:52 [auto1.de] INFO: Scrape type for ZR25455: 2
2026-03-29 07:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d378a9-3c59-5868-b88d-026cb56dc9e9 with identifier: ZR25455
2026-03-29 07:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d378a9-3c59-5868-b88d-026cb56dc9e9 with scrape type 2
2026-03-29 07:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70d378a9-3c59-5868-b88d-026cb56dc9e9 with scrape type 2
2026-03-29 07:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70d378a9-3c59-5868-b88d-026cb56dc9e9, identifier: ZR25455
2026-03-29 07:30:53 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-29 07:30:53 [auto1.de] INFO: Scrape type for AW14620: 2
2026-03-29 07:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92812258-493a-5600-9b11-b697f470484e with identifier: AW14620
2026-03-29 07:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92812258-493a-5600-9b11-b697f470484e with scrape type 2
2026-03-29 07:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92812258-493a-5600-9b11-b697f470484e with scrape type 2
2026-03-29 07:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92812258-493a-5600-9b11-b697f470484e, identifier: AW14620
2026-03-29 07:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70d378a9-3c59-5868-b88d-026cb56dc9e9 with identifier: ZR25455
2026-03-29 07:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70d378a9-3c59-5868-b88d-026cb56dc9e9 with identifier: ZR25455
2026-03-29 07:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70d378a9-3c59-5868-b88d-026cb56dc9e9 with identifier: ZR25455 to the API
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 612,
'expiration_date': '2026-03-30T15:01:24Z',
'fuel_type': 'petrol',
'id': '70d378a9-3c59-5868-b88d-026cb56dc9e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR25455',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 94980,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-14',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 63 AMG S T 4Matic',
'transmission': 'automatic',
'trim': 'S T 4Matic',
'year': 2021}
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-29 07:30:53 [auto1.de] INFO: Saving data for ZR25455: {'auction_closing_time': 1774882884.0, 'created_time': 1773426773.212233, 'last_price_update_time': 1774769453.47386}
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR25455') HTTP/1.1" 204 0
2026-03-29 07:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92812258-493a-5600-9b11-b697f470484e with identifier: AW14620
2026-03-29 07:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92812258-493a-5600-9b11-b697f470484e with identifier: AW14620
2026-03-29 07:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92812258-493a-5600-9b11-b697f470484e with identifier: AW14620 to the API
2026-03-29 07:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:45:29Z',
'fuel_type': 'diesel',
'id': '92812258-493a-5600-9b11-b697f470484e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW14620',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito Tourer',
'odometer': 149382,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-16',
'seller_name': None,
'title': 'Mercedes-Benz Vito Tourer 111 CDI extralang Pro',
'transmission': 'automatic',
'trim': 'extralang Pro',
'year': 2017}
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-29 07:30:54 [auto1.de] INFO: Saving data for AW14620: {'auction_closing_time': 1774885529.0, 'created_time': 1773830599.147862, 'last_price_update_time': 1774769454.391602}
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW14620') HTTP/1.1" 204 0
2026-03-29 07:30:54 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-29 07:30:54 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-29 07:30:54 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-29 07:30:54 [auto1.de] INFO: Scrape type for LT54057: 2
2026-03-29 07:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aef8ae9-86a2-5083-ba65-845ba25081ec with identifier: LT54057
2026-03-29 07:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aef8ae9-86a2-5083-ba65-845ba25081ec with scrape type 2
2026-03-29 07:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aef8ae9-86a2-5083-ba65-845ba25081ec with scrape type 2
2026-03-29 07:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aef8ae9-86a2-5083-ba65-845ba25081ec, identifier: LT54057
2026-03-29 07:30:54 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-29 07:30:54 [auto1.de] INFO: Scrape type for FM78793: 2
2026-03-29 07:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc2d0916-f1cc-5727-a655-538b5f7c91e5 with identifier: FM78793
2026-03-29 07:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2d0916-f1cc-5727-a655-538b5f7c91e5 with scrape type 2
2026-03-29 07:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc2d0916-f1cc-5727-a655-538b5f7c91e5 with scrape type 2
2026-03-29 07:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc2d0916-f1cc-5727-a655-538b5f7c91e5, identifier: FM78793
2026-03-29 07:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aef8ae9-86a2-5083-ba65-845ba25081ec with identifier: LT54057
2026-03-29 07:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aef8ae9-86a2-5083-ba65-845ba25081ec with identifier: LT54057
2026-03-29 07:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aef8ae9-86a2-5083-ba65-845ba25081ec with identifier: LT54057 to the API
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'diesel',
'id': '7aef8ae9-86a2-5083-ba65-845ba25081ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT54057',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 68671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-03',
'seller_name': None,
'title': 'Audi Q3 40 TDI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2022}
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-29 07:30:54 [auto1.de] INFO: Saving data for LT54057: {'auction_closing_time': 1774884844.0, 'created_time': 1773342731.026987, 'last_price_update_time': 1774769454.933626}
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT54057') HTTP/1.1" 204 0
2026-03-29 07:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc2d0916-f1cc-5727-a655-538b5f7c91e5 with identifier: FM78793
2026-03-29 07:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc2d0916-f1cc-5727-a655-538b5f7c91e5 with identifier: FM78793
2026-03-29 07:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc2d0916-f1cc-5727-a655-538b5f7c91e5 with identifier: FM78793 to the API
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:11:48Z',
'fuel_type': 'diesel',
'id': 'fc2d0916-f1cc-5727-a655-538b5f7c91e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM78793',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 206042,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-23',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2014}
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-29 07:30:55 [auto1.de] INFO: Saving data for FM78793: {'auction_closing_time': 1774883508.0, 'created_time': 1773341727.986367, 'last_price_update_time': 1774769455.265265}
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM78793') HTTP/1.1" 204 0
2026-03-29 07:30:55 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-29 07:30:55 [auto1.de] INFO: Scrape type for VY54552: 2
2026-03-29 07:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-29 07:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7881bd4-c71c-5250-8725-b543f5a04d69 with scrape type 2
2026-03-29 07:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7881bd4-c71c-5250-8725-b543f5a04d69 with scrape type 2
2026-03-29 07:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7881bd4-c71c-5250-8725-b543f5a04d69, identifier: VY54552
2026-03-29 07:30:55 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-29 07:30:55 [auto1.de] INFO: Scrape type for VH46900: 2
2026-03-29 07:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f3932a8-3cda-518f-8c94-93624cc7581d with identifier: VH46900
2026-03-29 07:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f3932a8-3cda-518f-8c94-93624cc7581d with scrape type 2
2026-03-29 07:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f3932a8-3cda-518f-8c94-93624cc7581d with scrape type 2
2026-03-29 07:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f3932a8-3cda-518f-8c94-93624cc7581d, identifier: VH46900
2026-03-29 07:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-29 07:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552
2026-03-29 07:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7881bd4-c71c-5250-8725-b543f5a04d69 with identifier: VY54552 to the API
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:21:59Z',
'fuel_type': 'hybrid',
'id': 'e7881bd4-c71c-5250-8725-b543f5a04d69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY54552',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 66959,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-02',
'seller_name': None,
'title': 'Audi A3 Sportback 45 TFSIe S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-29 07:30:55 [auto1.de] INFO: Saving data for VY54552: {'auction_closing_time': 1774884119.0, 'created_time': 1773305616.558535, 'last_price_update_time': 1774769455.821347}
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY54552') HTTP/1.1" 204 0
2026-03-29 07:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f3932a8-3cda-518f-8c94-93624cc7581d with identifier: VH46900
2026-03-29 07:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 07:30:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f3932a8-3cda-518f-8c94-93624cc7581d with identifier: VH46900
2026-03-29 07:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f3932a8-3cda-518f-8c94-93624cc7581d with identifier: VH46900 to the API
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:23:18Z',
'fuel_type': 'petrol',
'id': '7f3932a8-3cda-518f-8c94-93624cc7581d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH46900',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 278758,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-29',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2012}
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-29 07:30:56 [auto1.de] INFO: Saving data for VH46900: {'auction_closing_time': 1774884198.0, 'created_time': 1773830503.89148, 'last_price_update_time': 1774769456.381858}
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH46900') HTTP/1.1" 204 0
2026-03-29 07:30:56 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-29 07:30:56 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-29 07:30:56 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-29 07:30:56 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-29 07:30:56 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ78269%27 HTTP/1.1" 200 None
2026-03-29 07:30:56 [auto1.de] INFO: Scrape type for GJ78269: 2
2026-03-29 07:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4da8f8c-017c-5601-8d1c-1542e1aed70f with identifier: GJ78269
2026-03-29 07:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4da8f8c-017c-5601-8d1c-1542e1aed70f with scrape type 2
2026-03-29 07:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4da8f8c-017c-5601-8d1c-1542e1aed70f with scrape type 2
2026-03-29 07:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4da8f8c-017c-5601-8d1c-1542e1aed70f, identifier: GJ78269
2026-03-29 07:30:56 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN75041%27 HTTP/1.1" 200 None
2026-03-29 07:30:56 [auto1.de] INFO: Scrape type for ZN75041: 2
2026-03-29 07:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cec837e-326e-5f26-89f3-09ed1d22685c with identifier: ZN75041
2026-03-29 07:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cec837e-326e-5f26-89f3-09ed1d22685c with scrape type 2
2026-03-29 07:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cec837e-326e-5f26-89f3-09ed1d22685c with scrape type 2
2026-03-29 07:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cec837e-326e-5f26-89f3-09ed1d22685c, identifier: ZN75041
2026-03-29 07:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4da8f8c-017c-5601-8d1c-1542e1aed70f with identifier: GJ78269
2026-03-29 07:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4da8f8c-017c-5601-8d1c-1542e1aed70f with identifier: GJ78269
2026-03-29 07:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4da8f8c-017c-5601-8d1c-1542e1aed70f with identifier: GJ78269 to the API
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 550,
'expiration_date': '2026-03-30T15:27:43Z',
'fuel_type': 'petrol',
'id': 'f4da8f8c-017c-5601-8d1c-1542e1aed70f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ78269',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 186344,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-24',
'seller_name': None,
'title': 'Porsche Cayenne Turbo',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ78269%27 HTTP/1.1" 200 None
2026-03-29 07:30:56 [auto1.de] INFO: Saving data for GJ78269: {'auction_closing_time': 1774884463.0, 'created_time': 1773467484.212788, 'last_price_update_time': 1774769456.92214}
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ78269') HTTP/1.1" 204 0
2026-03-29 07:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cec837e-326e-5f26-89f3-09ed1d22685c with identifier: ZN75041
2026-03-29 07:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cec837e-326e-5f26-89f3-09ed1d22685c with identifier: ZN75041
2026-03-29 07:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cec837e-326e-5f26-89f3-09ed1d22685c with identifier: ZN75041 to the API
2026-03-29 07:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:28:47Z',
'fuel_type': 'diesel',
'id': '2cec837e-326e-5f26-89f3-09ed1d22685c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN75041',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 127209,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-09',
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 07:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN75041%27 HTTP/1.1" 200 None
2026-03-29 07:30:57 [auto1.de] INFO: Saving data for ZN75041: {'auction_closing_time': 1774884527.0, 'created_time': 1773662009.355638, 'last_price_update_time': 1774769457.938707}
2026-03-29 07:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN75041') HTTP/1.1" 204 0
2026-03-29 07:30:57 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-29 07:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-29 07:30:57 [auto1.de] INFO: Scrape type for HW71141: 2
2026-03-29 07:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-29 07:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e93732eb-d180-5f0d-b1c8-ee587ec97272 with scrape type 2
2026-03-29 07:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e93732eb-d180-5f0d-b1c8-ee587ec97272 with scrape type 2
2026-03-29 07:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e93732eb-d180-5f0d-b1c8-ee587ec97272, identifier: HW71141
2026-03-29 07:30:58 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-29 07:30:58 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-29 07:30:58 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-29 07:30:58 [auto1.de] INFO: Scrape type for UW93361: 2
2026-03-29 07:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94680422-3daf-51e2-a6cb-f7799eb90af6 with identifier: UW93361
2026-03-29 07:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94680422-3daf-51e2-a6cb-f7799eb90af6 with scrape type 2
2026-03-29 07:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94680422-3daf-51e2-a6cb-f7799eb90af6 with scrape type 2
2026-03-29 07:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94680422-3daf-51e2-a6cb-f7799eb90af6, identifier: UW93361
2026-03-29 07:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-29 07:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141
2026-03-29 07:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e93732eb-d180-5f0d-b1c8-ee587ec97272 with identifier: HW71141 to the API
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:19:25Z',
'fuel_type': 'petrol',
'id': 'e93732eb-d180-5f0d-b1c8-ee587ec97272',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW71141',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 225463,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-29',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2009}
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-29 07:30:58 [auto1.de] INFO: Saving data for HW71141: {'auction_closing_time': 1774883965.0, 'created_time': 1773303892.458719, 'last_price_update_time': 1774769458.461398}
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW71141') HTTP/1.1" 204 0
2026-03-29 07:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94680422-3daf-51e2-a6cb-f7799eb90af6 with identifier: UW93361
2026-03-29 07:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94680422-3daf-51e2-a6cb-f7799eb90af6 with identifier: UW93361
2026-03-29 07:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94680422-3daf-51e2-a6cb-f7799eb90af6 with identifier: UW93361 to the API
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:25Z',
'fuel_type': 'diesel',
'id': '94680422-3daf-51e2-a6cb-f7799eb90af6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW93361',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 225754,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-09',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2014}
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-29 07:30:58 [auto1.de] INFO: Saving data for UW93361: {'auction_closing_time': 1774884205.0, 'created_time': 1773138098.164829, 'last_price_update_time': 1774769458.795319}
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW93361') HTTP/1.1" 204 0
2026-03-29 07:30:58 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-29 07:30:58 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-29 07:30:58 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-29 07:30:58 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-29 07:30:58 [auto1.de] INFO: Scrape type for EM69554: 2
2026-03-29 07:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-29 07:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with scrape type 2
2026-03-29 07:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with scrape type 2
2026-03-29 07:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e, identifier: EM69554
2026-03-29 07:30:58 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-29 07:30:58 [auto1.de] INFO: Scrape type for YY00897: 2
2026-03-29 07:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with identifier: YY00897
2026-03-29 07:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with scrape type 2
2026-03-29 07:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with scrape type 2
2026-03-29 07:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce, identifier: YY00897
2026-03-29 07:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-29 07:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554
2026-03-29 07:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84b7ba83-b1ef-583f-a99b-c4dab9b3c21e with identifier: EM69554 to the API
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:03:16Z',
'fuel_type': 'petrol',
'id': '84b7ba83-b1ef-583f-a99b-c4dab9b3c21e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM69554',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 176440,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-26',
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-29 07:30:59 [auto1.de] INFO: Saving data for EM69554: {'auction_closing_time': 1774882996.0, 'created_time': 1773229236.068166, 'last_price_update_time': 1774769459.416108}
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM69554') HTTP/1.1" 204 0
2026-03-29 07:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with identifier: YY00897
2026-03-29 07:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with identifier: YY00897
2026-03-29 07:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce with identifier: YY00897 to the API
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:33:49Z',
'fuel_type': 'petrol',
'id': 'e78086ae-c1f9-5ce5-bfc9-0e3343bda1ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY00897',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 146995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-06',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2018}
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-29 07:30:59 [auto1.de] INFO: Saving data for YY00897: {'auction_closing_time': 1774884829.0, 'created_time': 1773830757.23125, 'last_price_update_time': 1774769459.866939}
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY00897') HTTP/1.1" 204 0
2026-03-29 07:30:59 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-29 07:30:59 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU39655%27 HTTP/1.1" 200 None
2026-03-29 07:30:59 [auto1.de] INFO: Scrape type for EU39655: 2
2026-03-29 07:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with identifier: EU39655
2026-03-29 07:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with scrape type 2
2026-03-29 07:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with scrape type 2
2026-03-29 07:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd, identifier: EU39655
2026-03-29 07:30:59 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-29 07:31:00 [auto1.de] INFO: Scrape type for DE21080: 2
2026-03-29 07:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20dc142c-330f-560a-ae67-167ed8230068 with identifier: DE21080
2026-03-29 07:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20dc142c-330f-560a-ae67-167ed8230068 with scrape type 2
2026-03-29 07:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20dc142c-330f-560a-ae67-167ed8230068 with scrape type 2
2026-03-29 07:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20dc142c-330f-560a-ae67-167ed8230068, identifier: DE21080
2026-03-29 07:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with identifier: EU39655
2026-03-29 07:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with identifier: EU39655
2026-03-29 07:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339546c0-fb26-5a45-b3aa-cb4dd03d97bd with identifier: EU39655 to the API
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:45:49Z',
'fuel_type': 'diesel',
'id': '339546c0-fb26-5a45-b3aa-cb4dd03d97bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU39655',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 179892,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-14',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2013}
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU39655%27 HTTP/1.1" 200 None
2026-03-29 07:31:00 [auto1.de] INFO: Saving data for EU39655: {'auction_closing_time': 1774885549.0, 'created_time': 1773830439.554433, 'last_price_update_time': 1774769460.432482}
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU39655') HTTP/1.1" 204 0
2026-03-29 07:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20dc142c-330f-560a-ae67-167ed8230068 with identifier: DE21080
2026-03-29 07:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20dc142c-330f-560a-ae67-167ed8230068 with identifier: DE21080
2026-03-29 07:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20dc142c-330f-560a-ae67-167ed8230068 with identifier: DE21080 to the API
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:24:36Z',
'fuel_type': 'petrol',
'id': '20dc142c-330f-560a-ae67-167ed8230068',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE21080',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 48184,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-23',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-29 07:31:00 [auto1.de] INFO: Saving data for DE21080: {'auction_closing_time': 1774884276.0, 'created_time': 1773227400.565206, 'last_price_update_time': 1774769460.784673}
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE21080') HTTP/1.1" 204 0
2026-03-29 07:31:00 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-29 07:31:00 [auto1.de] INFO: Scrape type for TX59054: 2
2026-03-29 07:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with identifier: TX59054
2026-03-29 07:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with scrape type 2
2026-03-29 07:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with scrape type 2
2026-03-29 07:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105, identifier: TX59054
2026-03-29 07:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with identifier: TX59054
2026-03-29 07:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with identifier: TX59054
2026-03-29 07:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c78a9d0-7d1b-5436-a1fc-bdf3bd400105 with identifier: TX59054 to the API
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:12Z',
'fuel_type': 'diesel',
'id': '6c78a9d0-7d1b-5436-a1fc-bdf3bd400105',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX59054',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 108114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Beach',
'transmission': 'manual',
'trim': 'Beach',
'year': 2019}
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-29 07:31:01 [auto1.de] INFO: Saving data for TX59054: {'auction_closing_time': 1774886052.0, 'created_time': 1773306475.897774, 'last_price_update_time': 1774769461.212204}
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX59054') HTTP/1.1" 204 0
2026-03-29 07:31:01 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 6229 | hits on page: 40
2026-03-29 07:31:01 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-29 07:31:01 [auto1.de] INFO: Scrape type for RV72867: 2
2026-03-29 07:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69246b1-c72f-5cdd-a792-f25834853c90 with identifier: RV72867
2026-03-29 07:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69246b1-c72f-5cdd-a792-f25834853c90 with scrape type 2
2026-03-29 07:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69246b1-c72f-5cdd-a792-f25834853c90 with scrape type 2
2026-03-29 07:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c69246b1-c72f-5cdd-a792-f25834853c90, identifier: RV72867
2026-03-29 07:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c69246b1-c72f-5cdd-a792-f25834853c90 with identifier: RV72867
2026-03-29 07:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c69246b1-c72f-5cdd-a792-f25834853c90 with identifier: RV72867
2026-03-29 07:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c69246b1-c72f-5cdd-a792-f25834853c90 with identifier: RV72867 to the API
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:39:13Z',
'fuel_type': 'diesel',
'id': 'c69246b1-c72f-5cdd-a792-f25834853c90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV72867',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Crafter',
'odometer': 333127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-10',
'seller_name': None,
'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 kurzer Radstand',
'transmission': 'manual',
'trim': 'Kasten 35 kurzer Radstand',
'year': 2015}
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-29 07:31:01 [auto1.de] INFO: Saving data for RV72867: {'auction_closing_time': 1774885153.0, 'created_time': 1772729110.013853, 'last_price_update_time': 1774769461.718281}
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV72867') HTTP/1.1" 204 0
2026-03-29 07:31:01 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-29 07:31:01 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-29 07:31:01 [auto1.de] INFO: Scrape type for VS05622: 2
2026-03-29 07:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a840542-4077-5a10-87ff-48b220ddf332 with identifier: VS05622
2026-03-29 07:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a840542-4077-5a10-87ff-48b220ddf332 with scrape type 2
2026-03-29 07:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a840542-4077-5a10-87ff-48b220ddf332 with scrape type 2
2026-03-29 07:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a840542-4077-5a10-87ff-48b220ddf332, identifier: VS05622
2026-03-29 07:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:01 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT69734%27 HTTP/1.1" 200 None
2026-03-29 07:31:01 [auto1.de] INFO: Scrape type for XT69734: 2
2026-03-29 07:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with identifier: XT69734
2026-03-29 07:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with scrape type 2
2026-03-29 07:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with scrape type 2
2026-03-29 07:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9293e556-446b-55c8-bb14-ee9a6e17a8a9, identifier: XT69734
2026-03-29 07:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a840542-4077-5a10-87ff-48b220ddf332 with identifier: VS05622
2026-03-29 07:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a840542-4077-5a10-87ff-48b220ddf332 with identifier: VS05622
2026-03-29 07:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a840542-4077-5a10-87ff-48b220ddf332 with identifier: VS05622 to the API
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 281,
'expiration_date': '2026-03-30T15:57:10Z',
'fuel_type': 'petrol',
'id': '5a840542-4077-5a10-87ff-48b220ddf332',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS05622',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 19548,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-11',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2023}
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-29 07:31:02 [auto1.de] INFO: Saving data for VS05622: {'auction_closing_time': 1774886230.0, 'created_time': 1772544495.799362, 'last_price_update_time': 1774769462.2714}
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS05622') HTTP/1.1" 204 0
2026-03-29 07:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with identifier: XT69734
2026-03-29 07:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with identifier: XT69734
2026-03-29 07:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9293e556-446b-55c8-bb14-ee9a6e17a8a9 with identifier: XT69734 to the API
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:34:07Z',
'fuel_type': 'diesel',
'id': '9293e556-446b-55c8-bb14-ee9a6e17a8a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT69734',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 49878,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-27',
'seller_name': None,
'title': 'BMW 1er 120d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2023}
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT69734%27 HTTP/1.1" 200 None
2026-03-29 07:31:02 [auto1.de] INFO: Saving data for XT69734: {'auction_closing_time': 1774884847.0, 'created_time': 1774378031.921602, 'last_price_update_time': 1774769462.608114}
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT69734') HTTP/1.1" 204 0
2026-03-29 07:31:02 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-29 07:31:02 [auto1.de] INFO: Scrape type for CU27746: 2
2026-03-29 07:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-29 07:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with scrape type 2
2026-03-29 07:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with scrape type 2
2026-03-29 07:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27, identifier: CU27746
2026-03-29 07:31:02 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-29 07:31:02 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-29 07:31:02 [auto1.de] INFO: Scrape type for XF01324: 2
2026-03-29 07:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b997853-189c-5469-b402-b6b40f9097bf with identifier: XF01324
2026-03-29 07:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b997853-189c-5469-b402-b6b40f9097bf with scrape type 2
2026-03-29 07:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b997853-189c-5469-b402-b6b40f9097bf with scrape type 2
2026-03-29 07:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b997853-189c-5469-b402-b6b40f9097bf, identifier: XF01324
2026-03-29 07:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-29 07:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746
2026-03-29 07:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e3dc7ee-5ff9-58e5-9852-a905648d4a27 with identifier: CU27746 to the API
2026-03-29 07:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:22Z',
'fuel_type': 'petrol',
'id': '3e3dc7ee-5ff9-58e5-9852-a905648d4a27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU27746',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 50920,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-09',
'seller_name': None,
'title': 'Audi Q2 35 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-29 07:31:03 [auto1.de] INFO: Saving data for CU27746: {'auction_closing_time': 1774886242.0, 'created_time': 1773302561.97334, 'last_price_update_time': 1774769463.141062}
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU27746') HTTP/1.1" 204 0
2026-03-29 07:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b997853-189c-5469-b402-b6b40f9097bf with identifier: XF01324
2026-03-29 07:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b997853-189c-5469-b402-b6b40f9097bf with identifier: XF01324
2026-03-29 07:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b997853-189c-5469-b402-b6b40f9097bf with identifier: XF01324 to the API
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:01:04Z',
'fuel_type': 'petrol',
'id': '2b997853-189c-5469-b402-b6b40f9097bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF01324',
'listing': 'auction',
'make': 'MINI',
'model': 'Cabrio',
'odometer': 130542,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-30',
'seller_name': None,
'title': 'MINI Cabrio Cooper',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-29 07:31:03 [auto1.de] INFO: Saving data for XF01324: {'auction_closing_time': 1774882864.0, 'created_time': 1773830257.107238, 'last_price_update_time': 1774769463.546746}
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF01324') HTTP/1.1" 204 0
2026-03-29 07:31:03 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-29 07:31:03 [auto1.de] INFO: Scrape type for UN73859: 2
2026-03-29 07:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-29 07:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a426c313-2e75-5a1b-8f7d-c6468b298c26 with scrape type 2
2026-03-29 07:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a426c313-2e75-5a1b-8f7d-c6468b298c26 with scrape type 2
2026-03-29 07:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a426c313-2e75-5a1b-8f7d-c6468b298c26, identifier: UN73859
2026-03-29 07:31:03 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP89204%27 HTTP/1.1" 200 None
2026-03-29 07:31:03 [auto1.de] INFO: Scrape type for UP89204: 1
2026-03-29 07:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-29 07:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859
2026-03-29 07:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a426c313-2e75-5a1b-8f7d-c6468b298c26 with identifier: UN73859 to the API
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:03Z',
'fuel_type': 'petrol',
'id': 'a426c313-2e75-5a1b-8f7d-c6468b298c26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN73859',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 53357,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-04-27',
'seller_name': None,
'title': 'Skoda Kamiq 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-29 07:31:04 [auto1.de] INFO: Saving data for UN73859: {'auction_closing_time': 1774885323.0, 'created_time': 1773226787.943211, 'last_price_update_time': 1774769464.023182}
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN73859') HTTP/1.1" 204 0
2026-03-29 07:31:04 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-29 07:31:04 [auto1.de] INFO: Scrape type for VG22194: 2
2026-03-29 07:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3804140f-7c41-508c-84fa-c1a93a29189c with identifier: VG22194
2026-03-29 07:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3804140f-7c41-508c-84fa-c1a93a29189c with scrape type 2
2026-03-29 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3804140f-7c41-508c-84fa-c1a93a29189c with scrape type 2
2026-03-29 07:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3804140f-7c41-508c-84fa-c1a93a29189c, identifier: VG22194
2026-03-29 07:31:04 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-29 07:31:04 [auto1.de] INFO: Scrape type for TZ11746: 2
2026-03-29 07:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with identifier: TZ11746
2026-03-29 07:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with scrape type 2
2026-03-29 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with scrape type 2
2026-03-29 07:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2, identifier: TZ11746
2026-03-29 07:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3804140f-7c41-508c-84fa-c1a93a29189c with identifier: VG22194
2026-03-29 07:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3804140f-7c41-508c-84fa-c1a93a29189c with identifier: VG22194
2026-03-29 07:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3804140f-7c41-508c-84fa-c1a93a29189c with identifier: VG22194 to the API
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 520,
'expiration_date': '2026-03-30T15:12:39Z',
'fuel_type': 'petrol',
'id': '3804140f-7c41-508c-84fa-c1a93a29189c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG22194',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 110138,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-01',
'seller_name': None,
'title': 'Porsche Cayenne Turbo',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-29 07:31:04 [auto1.de] INFO: Saving data for VG22194: {'auction_closing_time': 1774883559.0, 'created_time': 1773343838.406001, 'last_price_update_time': 1774769464.587963}
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG22194') HTTP/1.1" 204 0
2026-03-29 07:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with identifier: TZ11746
2026-03-29 07:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with identifier: TZ11746
2026-03-29 07:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2 with identifier: TZ11746 to the API
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:01:31Z',
'fuel_type': 'petrol',
'id': 'da69c3bf-c5a7-5af9-96fb-c594a1e2e5a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ11746',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 30357,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-25',
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2025}
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-29 07:31:04 [auto1.de] INFO: Saving data for TZ11746: {'auction_closing_time': 1774882891.0, 'created_time': 1773307080.671369, 'last_price_update_time': 1774769464.940272}
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ11746') HTTP/1.1" 204 0
2026-03-29 07:31:04 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-29 07:31:04 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-29 07:31:04 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-29 07:31:04 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-29 07:31:04 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-29 07:31:04 [auto1.de] INFO: Scrape type for JT90882: 2
2026-03-29 07:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with identifier: JT90882
2026-03-29 07:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with scrape type 2
2026-03-29 07:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with scrape type 2
2026-03-29 07:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245, identifier: JT90882
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-29 07:31:05 [auto1.de] INFO: Scrape type for ZK08136: 1
2026-03-29 07:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with identifier: JT90882
2026-03-29 07:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with identifier: JT90882
2026-03-29 07:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecb85be3-f9b2-5dbb-9ea5-32d1cc207245 with identifier: JT90882 to the API
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:34:52Z',
'fuel_type': 'diesel',
'id': 'ecb85be3-f9b2-5dbb-9ea5-32d1cc207245',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT90882',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 70433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-07',
'seller_name': None,
'title': 'Ford Ranger 2.2 TDCi Doppelkabine Limited 4x4',
'transmission': 'automatic',
'trim': 'Doppelkabine Limited 4x4',
'year': 2016}
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-29 07:31:05 [auto1.de] INFO: Saving data for JT90882: {'auction_closing_time': 1774884892.0, 'created_time': 1773308317.998933, 'last_price_update_time': 1774769465.416078}
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT90882') HTTP/1.1" 204 0
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-29 07:31:05 [auto1.de] INFO: Scrape type for AJ18698: 2
2026-03-29 07:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with identifier: AJ18698
2026-03-29 07:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with scrape type 2
2026-03-29 07:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with scrape type 2
2026-03-29 07:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ddcb168-bb8e-5e82-b533-4207d3dc1331, identifier: AJ18698
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-29 07:31:05 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-29 07:31:05 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-29 07:31:05 [auto1.de] INFO: Scrape type for CU27746: 0
2026-03-29 07:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with identifier: AJ18698
2026-03-29 07:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with identifier: AJ18698
2026-03-29 07:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ddcb168-bb8e-5e82-b533-4207d3dc1331 with identifier: AJ18698 to the API
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:28:29Z',
'fuel_type': 'petrol',
'id': '0ddcb168-bb8e-5e82-b533-4207d3dc1331',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ18698',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 220811,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-27',
'seller_name': None,
'title': 'Ford Kuga 1.6 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-29 07:31:05 [auto1.de] INFO: Saving data for AJ18698: {'auction_closing_time': 1774884509.0, 'created_time': 1773226388.45839, 'last_price_update_time': 1774769465.987281}
2026-03-29 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ18698') HTTP/1.1" 204 0
2026-03-29 07:31:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:06 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-29 07:31:06 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-29 07:31:06 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-29 07:31:06 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-29 07:31:06 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-29 07:31:06 [auto1.de] INFO: Scrape type for AG68218: 2
2026-03-29 07:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-29 07:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34a89eef-88d5-59ba-b6f7-bbf703b788ae with scrape type 2
2026-03-29 07:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34a89eef-88d5-59ba-b6f7-bbf703b788ae with scrape type 2
2026-03-29 07:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34a89eef-88d5-59ba-b6f7-bbf703b788ae, identifier: AG68218
2026-03-29 07:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-29 07:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218
2026-03-29 07:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34a89eef-88d5-59ba-b6f7-bbf703b788ae with identifier: AG68218 to the API
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:23:31Z',
'fuel_type': 'petrol',
'id': '34a89eef-88d5-59ba-b6f7-bbf703b788ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG68218',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 93848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-11',
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 Diamant Edition 2WD',
'transmission': 'manual',
'trim': 'Diamant Edition 2WD',
'year': 2015}
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-29 07:31:06 [auto1.de] INFO: Saving data for AG68218: {'auction_closing_time': 1774884211.0, 'created_time': 1773224937.532251, 'last_price_update_time': 1774769466.424474}
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG68218') HTTP/1.1" 204 0
2026-03-29 07:31:06 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-29 07:31:06 [auto1.de] INFO: Scrape type for YZ27957: 2
2026-03-29 07:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with identifier: YZ27957
2026-03-29 07:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with scrape type 2
2026-03-29 07:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with scrape type 2
2026-03-29 07:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e1ab8c8-047f-55d5-b305-ca12c30015d3, identifier: YZ27957
2026-03-29 07:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with identifier: YZ27957
2026-03-29 07:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with identifier: YZ27957
2026-03-29 07:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e1ab8c8-047f-55d5-b305-ca12c30015d3 with identifier: YZ27957 to the API
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:09Z',
'fuel_type': 'diesel',
'id': '8e1ab8c8-047f-55d5-b305-ca12c30015d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ27957',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 192969,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-06',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-29 07:31:06 [auto1.de] INFO: Saving data for YZ27957: {'auction_closing_time': 1774885329.0, 'created_time': 1773830668.039382, 'last_price_update_time': 1774769466.967281}
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ27957') HTTP/1.1" 204 0
2026-03-29 07:31:06 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-29 07:31:06 [auto1.de] INFO: Scrape type for GA63896: 2
2026-03-29 07:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with identifier: GA63896
2026-03-29 07:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with scrape type 2
2026-03-29 07:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with scrape type 2
2026-03-29 07:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677, identifier: GA63896
2026-03-29 07:31:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 8 pages/min), scraped 68 items (at 68 items/min)
2026-03-29 07:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-29 07:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with identifier: GA63896
2026-03-29 07:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with identifier: GA63896
2026-03-29 07:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cfbdd2b-77fb-5652-8e5d-2ff509c86677 with identifier: GA63896 to the API
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:22:07Z',
'fuel_type': 'petrol',
'id': '8cfbdd2b-77fb-5652-8e5d-2ff509c86677',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA63896',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 102114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-08',
'seller_name': None,
'title': 'BMW 3er 320i',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-29 07:31:07 [auto1.de] INFO: Saving data for GA63896: {'auction_closing_time': 1774884127.0, 'created_time': 1773226226.342969, 'last_price_update_time': 1774769467.39974}
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA63896') HTTP/1.1" 204 0
2026-03-29 07:31:07 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-29 07:31:07 [auto1.de] INFO: Scrape type for YP19468: 2
2026-03-29 07:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3659ad43-83e7-5d70-abce-9537202d1677 with identifier: YP19468
2026-03-29 07:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3659ad43-83e7-5d70-abce-9537202d1677 with scrape type 2
2026-03-29 07:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3659ad43-83e7-5d70-abce-9537202d1677 with scrape type 2
2026-03-29 07:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3659ad43-83e7-5d70-abce-9537202d1677, identifier: YP19468
2026-03-29 07:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3659ad43-83e7-5d70-abce-9537202d1677 with identifier: YP19468
2026-03-29 07:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3659ad43-83e7-5d70-abce-9537202d1677 with identifier: YP19468
2026-03-29 07:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3659ad43-83e7-5d70-abce-9537202d1677 with identifier: YP19468 to the API
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:49:47Z',
'fuel_type': 'petrol',
'id': '3659ad43-83e7-5d70-abce-9537202d1677',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP19468',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 209810,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-02-06',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2007}
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-29 07:31:07 [auto1.de] INFO: Saving data for YP19468: {'auction_closing_time': 1774885787.0, 'created_time': 1773307932.289852, 'last_price_update_time': 1774769467.842482}
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP19468') HTTP/1.1" 204 0
2026-03-29 07:31:07 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-29 07:31:07 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-29 07:31:07 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-29 07:31:07 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-29 07:31:07 [auto1.de] INFO: Scrape type for NZ51315: 2
2026-03-29 07:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with identifier: NZ51315
2026-03-29 07:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with scrape type 2
2026-03-29 07:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with scrape type 2
2026-03-29 07:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbb3f1e4-ffbd-56d2-a361-c83be56685a4, identifier: NZ51315
2026-03-29 07:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with identifier: NZ51315
2026-03-29 07:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with identifier: NZ51315
2026-03-29 07:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbb3f1e4-ffbd-56d2-a361-c83be56685a4 with identifier: NZ51315 to the API
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:31Z',
'fuel_type': 'diesel',
'id': 'bbb3f1e4-ffbd-56d2-a361-c83be56685a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ51315',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 273555,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-15',
'seller_name': None,
'title': 'Peugeot 5008 2.0 HDi Business-Line',
'transmission': 'manual',
'trim': 'Business-Line',
'year': 2011}
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-29 07:31:08 [auto1.de] INFO: Saving data for NZ51315: {'auction_closing_time': 1774884631.0, 'created_time': 1773302291.945328, 'last_price_update_time': 1774769468.274605}
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ51315') HTTP/1.1" 204 0
2026-03-29 07:31:08 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-29 07:31:08 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-29 07:31:08 [auto1.de] INFO: Scrape type for VH44928: 2
2026-03-29 07:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-29 07:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 711a995d-0893-5aa5-82cd-de12efe91e1d with scrape type 2
2026-03-29 07:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 711a995d-0893-5aa5-82cd-de12efe91e1d with scrape type 2
2026-03-29 07:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 711a995d-0893-5aa5-82cd-de12efe91e1d, identifier: VH44928
2026-03-29 07:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-29 07:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928
2026-03-29 07:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 711a995d-0893-5aa5-82cd-de12efe91e1d with identifier: VH44928 to the API
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:17:22Z',
'fuel_type': 'petrol',
'id': '711a995d-0893-5aa5-82cd-de12efe91e1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH44928',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 91606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-04',
'seller_name': None,
'title': 'Volkswagen Scirocco 1.4 TSI Sound BlueMotion',
'transmission': 'manual',
'trim': 'Sound BlueMotion',
'year': 2017}
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-29 07:31:08 [auto1.de] INFO: Saving data for VH44928: {'auction_closing_time': 1774883842.0, 'created_time': 1773741304.386548, 'last_price_update_time': 1774769468.68375}
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH44928') HTTP/1.1" 204 0
2026-03-29 07:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP89204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:08 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-29 07:31:08 [auto1.de] INFO: Scrape type for WC28645: 2
2026-03-29 07:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae4c18c-d9c8-5531-b482-80f14354ba28 with identifier: WC28645
2026-03-29 07:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae4c18c-d9c8-5531-b482-80f14354ba28 with scrape type 2
2026-03-29 07:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ae4c18c-d9c8-5531-b482-80f14354ba28 with scrape type 2
2026-03-29 07:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ae4c18c-d9c8-5531-b482-80f14354ba28, identifier: WC28645
2026-03-29 07:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ae4c18c-d9c8-5531-b482-80f14354ba28 with identifier: WC28645
2026-03-29 07:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ae4c18c-d9c8-5531-b482-80f14354ba28 with identifier: WC28645
2026-03-29 07:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ae4c18c-d9c8-5531-b482-80f14354ba28 with identifier: WC28645 to the API
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:58:24Z',
'fuel_type': 'petrol',
'id': '0ae4c18c-d9c8-5531-b482-80f14354ba28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC28645',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 190127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-14',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-29 07:31:09 [auto1.de] INFO: Saving data for WC28645: {'auction_closing_time': 1774886304.0, 'created_time': 1773305426.761809, 'last_price_update_time': 1774769469.099245}
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC28645') HTTP/1.1" 204 0
2026-03-29 07:31:09 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 6232 | hits on page: 40
2026-03-29 07:31:09 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-29 07:31:09 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-29 07:31:09 [auto1.de] INFO: Scrape type for LN11604: 2
2026-03-29 07:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604
2026-03-29 07:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b80449-7956-50df-9983-34aaaefb94f6 with scrape type 2
2026-03-29 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b80449-7956-50df-9983-34aaaefb94f6 with scrape type 2
2026-03-29 07:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4b80449-7956-50df-9983-34aaaefb94f6, identifier: LN11604
2026-03-29 07:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK08136/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604
2026-03-29 07:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604
2026-03-29 07:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4b80449-7956-50df-9983-34aaaefb94f6 with identifier: LN11604 to the API
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:08:10Z',
'fuel_type': 'diesel',
'id': 'a4b80449-7956-50df-9983-34aaaefb94f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN11604',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 113258,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-16',
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
'transmission': 'automatic',
'trim': 'Q4 Business',
'year': 2021}
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-29 07:31:09 [auto1.de] INFO: Saving data for LN11604: {'auction_closing_time': 1774883290.0, 'created_time': 1773307214.245842, 'last_price_update_time': 1774769469.561094}
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN11604') HTTP/1.1" 204 0
2026-03-29 07:31:09 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-29 07:31:09 [auto1.de] INFO: Scrape type for GS84935: 2
2026-03-29 07:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-29 07:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859b9249-7552-5854-8a32-db9638949e5f with scrape type 2
2026-03-29 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859b9249-7552-5854-8a32-db9638949e5f with scrape type 2
2026-03-29 07:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 859b9249-7552-5854-8a32-db9638949e5f, identifier: GS84935
2026-03-29 07:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:09 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-29 07:31:09 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-29 07:31:09 [auto1.de] INFO: Scrape type for XR19518: 2
2026-03-29 07:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518
2026-03-29 07:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b312986e-b568-512f-aa36-365a041548b7 with scrape type 2
2026-03-29 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b312986e-b568-512f-aa36-365a041548b7 with scrape type 2
2026-03-29 07:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b312986e-b568-512f-aa36-365a041548b7, identifier: XR19518
2026-03-29 07:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-29 07:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935
2026-03-29 07:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 859b9249-7552-5854-8a32-db9638949e5f with identifier: GS84935 to the API
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:23:29Z',
'fuel_type': 'diesel',
'id': '859b9249-7552-5854-8a32-db9638949e5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS84935',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 135691,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-17',
'seller_name': None,
'title': 'Renault Grand Scenic 1.6 dCi Energy BOSE-Edition',
'transmission': 'automatic',
'trim': 'BOSE-Edition',
'year': 2017}
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-29 07:31:10 [auto1.de] INFO: Saving data for GS84935: {'auction_closing_time': 1774884209.0, 'created_time': 1773304057.930398, 'last_price_update_time': 1774769470.25893}
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS84935') HTTP/1.1" 204 0
2026-03-29 07:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518
2026-03-29 07:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518
2026-03-29 07:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b312986e-b568-512f-aa36-365a041548b7 with identifier: XR19518 to the API
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:19:10Z',
'fuel_type': 'petrol',
'id': 'b312986e-b568-512f-aa36-365a041548b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR19518',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 77525,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-17',
'seller_name': None,
'title': 'MINI One First',
'transmission': 'manual',
'trim': 'First',
'year': 2015}
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-29 07:31:10 [auto1.de] INFO: Saving data for XR19518: {'auction_closing_time': 1774883950.0, 'created_time': 1773229377.561692, 'last_price_update_time': 1774769470.595844}
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR19518') HTTP/1.1" 204 0
2026-03-29 07:31:10 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-29 07:31:10 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-29 07:31:10 [auto1.de] INFO: Scrape type for UK22592: 2
2026-03-29 07:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49009fc8-95b9-5c1b-9142-4f5469415d52 with identifier: UK22592
2026-03-29 07:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49009fc8-95b9-5c1b-9142-4f5469415d52 with scrape type 2
2026-03-29 07:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49009fc8-95b9-5c1b-9142-4f5469415d52 with scrape type 2
2026-03-29 07:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49009fc8-95b9-5c1b-9142-4f5469415d52, identifier: UK22592
2026-03-29 07:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:10 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-29 07:31:10 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-29 07:31:10 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-29 07:31:10 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-29 07:31:10 [auto1.de] INFO: Scrape type for FE98948: 2
2026-03-29 07:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948
2026-03-29 07:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with scrape type 2
2026-03-29 07:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with scrape type 2
2026-03-29 07:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d, identifier: FE98948
2026-03-29 07:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49009fc8-95b9-5c1b-9142-4f5469415d52 with identifier: UK22592
2026-03-29 07:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49009fc8-95b9-5c1b-9142-4f5469415d52 with identifier: UK22592
2026-03-29 07:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49009fc8-95b9-5c1b-9142-4f5469415d52 with identifier: UK22592 to the API
2026-03-29 07:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:59:20Z',
'fuel_type': 'petrol',
'id': '49009fc8-95b9-5c1b-9142-4f5469415d52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK22592',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 91948,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-30',
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-29 07:31:11 [auto1.de] INFO: Saving data for UK22592: {'auction_closing_time': 1774886360.0, 'created_time': 1773308312.802282, 'last_price_update_time': 1774769471.170141}
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK22592') HTTP/1.1" 204 0
2026-03-29 07:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948
2026-03-29 07:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948
2026-03-29 07:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5afd6e9-98f6-5f43-b8e4-9d1467d6802d with identifier: FE98948 to the API
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:02:24Z',
'fuel_type': 'diesel',
'id': 'e5afd6e9-98f6-5f43-b8e4-9d1467d6802d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE98948',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 121909,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-05',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
'transmission': 'automatic',
'trim': 'Allure L2',
'year': 2018}
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-29 07:31:11 [auto1.de] INFO: Saving data for FE98948: {'auction_closing_time': 1774882944.0, 'created_time': 1773830434.247647, 'last_price_update_time': 1774769471.499433}
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE98948') HTTP/1.1" 204 0
2026-03-29 07:31:11 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-29 07:31:11 [auto1.de] INFO: Scrape type for FU28651: 2
2026-03-29 07:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with identifier: FU28651
2026-03-29 07:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with scrape type 2
2026-03-29 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with scrape type 2
2026-03-29 07:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac, identifier: FU28651
2026-03-29 07:31:11 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-29 07:31:11 [auto1.de] INFO: Scrape type for GT84792: 0
2026-03-29 07:31:11 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-29 07:31:11 [auto1.de] INFO: Scrape type for GS84935: 0
2026-03-29 07:31:11 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-29 07:31:11 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-29 07:31:11 [auto1.de] INFO: Scrape type for UK22592: 0
2026-03-29 07:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with identifier: FU28651
2026-03-29 07:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with identifier: FU28651
2026-03-29 07:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64ac5bc4-3b2b-5a12-8754-d5e2069e1aac with identifier: FU28651 to the API
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:15:08Z',
'fuel_type': 'diesel',
'id': '64ac5bc4-3b2b-5a12-8754-d5e2069e1aac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU28651',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 154433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-29',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Exclusive',
'transmission': 'automatic',
'trim': 'T BlueTEC Exclusive',
'year': 2015}
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-29 07:31:11 [auto1.de] INFO: Saving data for FU28651: {'auction_closing_time': 1774883708.0, 'created_time': 1773341221.040528, 'last_price_update_time': 1774769471.977439}
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU28651') HTTP/1.1" 204 0
2026-03-29 07:31:12 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-29 07:31:12 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-29 07:31:12 [auto1.de] INFO: Scrape type for GY36946: 2
2026-03-29 07:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac59fd23-fbde-544e-9e26-f2427b284211 with identifier: GY36946
2026-03-29 07:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac59fd23-fbde-544e-9e26-f2427b284211 with scrape type 2
2026-03-29 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac59fd23-fbde-544e-9e26-f2427b284211 with scrape type 2
2026-03-29 07:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac59fd23-fbde-544e-9e26-f2427b284211, identifier: GY36946
2026-03-29 07:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac59fd23-fbde-544e-9e26-f2427b284211 with identifier: GY36946
2026-03-29 07:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac59fd23-fbde-544e-9e26-f2427b284211 with identifier: GY36946
2026-03-29 07:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac59fd23-fbde-544e-9e26-f2427b284211 with identifier: GY36946 to the API
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:36Z',
'fuel_type': 'petrol',
'id': 'ac59fd23-fbde-544e-9e26-f2427b284211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY36946',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 72940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-20',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI ACT Sound BlueMotion',
'transmission': 'manual',
'trim': 'Sound BlueMotion',
'year': 2017}
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-29 07:31:12 [auto1.de] INFO: Saving data for GY36946: {'auction_closing_time': 1774882836.0, 'created_time': 1773304404.97222, 'last_price_update_time': 1774769472.528671}
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY36946') HTTP/1.1" 204 0
2026-03-29 07:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:12 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-29 07:31:12 [auto1.de] INFO: Scrape type for PV67596: 2
2026-03-29 07:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-29 07:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with scrape type 2
2026-03-29 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with scrape type 2
2026-03-29 07:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4, identifier: PV67596
2026-03-29 07:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-29 07:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596
2026-03-29 07:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a97bb929-ab7e-58d6-8ccc-be5d1c033dd4 with identifier: PV67596 to the API
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:31:10Z',
'fuel_type': 'petrol',
'id': 'a97bb929-ab7e-58d6-8ccc-be5d1c033dd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV67596',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 204429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-15',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-29 07:31:12 [auto1.de] INFO: Saving data for PV67596: {'auction_closing_time': 1774884670.0, 'created_time': 1773741417.150559, 'last_price_update_time': 1774769472.971856}
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV67596') HTTP/1.1" 204 0
2026-03-29 07:31:12 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-29 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-29 07:31:13 [auto1.de] INFO: Scrape type for ET29931: 2
2026-03-29 07:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b54358-cb34-5f19-b37a-e4b31eed7074 with identifier: ET29931
2026-03-29 07:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b54358-cb34-5f19-b37a-e4b31eed7074 with scrape type 2
2026-03-29 07:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1b54358-cb34-5f19-b37a-e4b31eed7074 with scrape type 2
2026-03-29 07:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1b54358-cb34-5f19-b37a-e4b31eed7074, identifier: ET29931
2026-03-29 07:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1b54358-cb34-5f19-b37a-e4b31eed7074 with identifier: ET29931
2026-03-29 07:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1b54358-cb34-5f19-b37a-e4b31eed7074 with identifier: ET29931
2026-03-29 07:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1b54358-cb34-5f19-b37a-e4b31eed7074 with identifier: ET29931 to the API
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:17:44Z',
'fuel_type': 'diesel',
'id': 'c1b54358-cb34-5f19-b37a-e4b31eed7074',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET29931',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 394395,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-02',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2008}
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-29 07:31:13 [auto1.de] INFO: Saving data for ET29931: {'auction_closing_time': 1774883864.0, 'created_time': 1773226385.191327, 'last_price_update_time': 1774769473.40957}
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET29931') HTTP/1.1" 204 0
2026-03-29 07:31:13 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-29 07:31:13 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-29 07:31:13 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-29 07:31:13 [auto1.de] INFO: Scrape type for BP04527: 2
2026-03-29 07:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with identifier: BP04527
2026-03-29 07:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with scrape type 2
2026-03-29 07:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with scrape type 2
2026-03-29 07:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6f4adbf-c9cf-5e73-948a-c14f894df8a2, identifier: BP04527
2026-03-29 07:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with identifier: BP04527
2026-03-29 07:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with identifier: BP04527
2026-03-29 07:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6f4adbf-c9cf-5e73-948a-c14f894df8a2 with identifier: BP04527 to the API
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:10:27Z',
'fuel_type': 'diesel',
'id': 'e6f4adbf-c9cf-5e73-948a-c14f894df8a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP04527',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 130083,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-20',
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-29 07:31:13 [auto1.de] INFO: Saving data for BP04527: {'auction_closing_time': 1774883427.0, 'created_time': 1773304817.706272, 'last_price_update_time': 1774769473.835961}
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP04527') HTTP/1.1" 204 0
2026-03-29 07:31:13 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-29 07:31:13 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-29 07:31:13 [auto1.de] INFO: Scrape type for PW13353: 2
2026-03-29 07:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3acbe9e-0c4e-5f30-96b9-5de7425155be with identifier: PW13353
2026-03-29 07:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3acbe9e-0c4e-5f30-96b9-5de7425155be with scrape type 2
2026-03-29 07:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3acbe9e-0c4e-5f30-96b9-5de7425155be with scrape type 2
2026-03-29 07:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3acbe9e-0c4e-5f30-96b9-5de7425155be, identifier: PW13353
2026-03-29 07:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3acbe9e-0c4e-5f30-96b9-5de7425155be with identifier: PW13353
2026-03-29 07:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3acbe9e-0c4e-5f30-96b9-5de7425155be with identifier: PW13353
2026-03-29 07:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3acbe9e-0c4e-5f30-96b9-5de7425155be with identifier: PW13353 to the API
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:49:38Z',
'fuel_type': 'petrol',
'id': 'a3acbe9e-0c4e-5f30-96b9-5de7425155be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW13353',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 90489,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-21',
'seller_name': None,
'title': 'Audi Q2 1.4 TFSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-29 07:31:14 [auto1.de] INFO: Saving data for PW13353: {'auction_closing_time': 1774885778.0, 'created_time': 1773830845.810083, 'last_price_update_time': 1774769474.354351}
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW13353') HTTP/1.1" 204 0
2026-03-29 07:31:14 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-29 07:31:14 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-29 07:31:14 [auto1.de] INFO: Scrape type for JG07802: 2
2026-03-29 07:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4820be2-5991-5042-a105-0deabfe89a8d with identifier: JG07802
2026-03-29 07:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4820be2-5991-5042-a105-0deabfe89a8d with scrape type 2
2026-03-29 07:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4820be2-5991-5042-a105-0deabfe89a8d with scrape type 2
2026-03-29 07:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4820be2-5991-5042-a105-0deabfe89a8d, identifier: JG07802
2026-03-29 07:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4820be2-5991-5042-a105-0deabfe89a8d with identifier: JG07802
2026-03-29 07:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4820be2-5991-5042-a105-0deabfe89a8d with identifier: JG07802
2026-03-29 07:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4820be2-5991-5042-a105-0deabfe89a8d with identifier: JG07802 to the API
2026-03-29 07:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:13Z',
'fuel_type': 'petrol',
'id': 'c4820be2-5991-5042-a105-0deabfe89a8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG07802',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 105862,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-11',
'seller_name': None,
'title': 'Volkswagen Sharan 1.4 TSI Cup BlueMotion',
'transmission': 'manual',
'trim': 'Cup BlueMotion',
'year': 2015}
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Saving data for JG07802: {'auction_closing_time': 1774885093.0, 'created_time': 1773306695.449717, 'last_price_update_time': 1774769475.420969}
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG07802') HTTP/1.1" 204 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29433%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for RC29433: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE68062%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for YE68062: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18032%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for FV18032: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for JA02220: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for JN21638: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for MN30127: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY52280%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for AY52280: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37424%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for EY37424: 0
2026-03-29 07:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP89204> (referer: https://www.auto1.com/v1/car-details-view/UP89204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:15 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 6233 | hits on page: 40
2026-03-29 07:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK08136> (referer: https://www.auto1.com/v1/car-details-view/ZK08136/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37424%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for EY37424: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT94431%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for MT94431: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96844%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for PS96844: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH90644%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for DH90644: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17903%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for JX17903: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX25429%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for NX25429: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB30616%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for FB30616: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09444%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for EM09444: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ73179%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for KJ73179: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM07579%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for VM07579: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for XH18940: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ89172%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for UZ89172: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF06925%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for EF06925: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE56505%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for UE56505: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR93945%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for TR93945: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF10359%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for UF10359: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN60503%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for BN60503: 0
2026-03-29 07:31:15 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG41279%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [auto1.de] INFO: Scrape type for BG41279: 0
2026-03-29 07:31:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98645f04-9597-5f2a-8753-b69d88860c26 with identifier: UP89204
2026-03-29 07:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98645f04-9597-5f2a-8753-b69d88860c26 with scrape type 1
2026-03-29 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98645f04-9597-5f2a-8753-b69d88860c26
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_c51bb78725990b6cc8b4533e1baf67bd.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_c51bb78725990b6cc8b4533e1baf67bd.jpg already downloaded
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_1ac569270098e0c6d4ff3b1288739fd3.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_1ac569270098e0c6d4ff3b1288739fd3.jpg already downloaded
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_4f438a5e0798535e5ca30ac48f885cbe.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_4f438a5e0798535e5ca30ac48f885cbe.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_8668610b4f97e7f5d80b3ccadbe55d53.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_8668610b4f97e7f5d80b3ccadbe55d53.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_1d50bd98cbb72a9efd4c20ac0efcd4ad.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_1d50bd98cbb72a9efd4c20ac0efcd4ad.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_6fc9179bb60d2c907d980bfe97f4b5f0.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_6fc9179bb60d2c907d980bfe97f4b5f0.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_7b906e6235621bf046f5254b3e10d5b8.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_7b906e6235621bf046f5254b3e10d5b8.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_07a6d63ffdbdf0315e2af3435c229f8f.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_07a6d63ffdbdf0315e2af3435c229f8f.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_833e406234f02b95e9334406c78f0527.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_833e406234f02b95e9334406c78f0527.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc1%252F17c1ddfbb7714cb541496740d0f37bd1%252Fpa%252FUP89204_dbe900559386f1e4eb68749daf0ca41c.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_dbe900559386f1e4eb68749daf0ca41c.jpg already downloaded
2026-03-29 07:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98645f04-9597-5f2a-8753-b69d88860c26, identifier: UP89204
2026-03-29 07:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with identifier: ZK08136
2026-03-29 07:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with scrape type 1
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_8434e812eb77da4d0ba4987703c4a314.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_8434e812eb77da4d0ba4987703c4a314.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_6948c9986c9dbcd3cbb3036eca20f453.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_6948c9986c9dbcd3cbb3036eca20f453.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_22098ae468b81cdca33a56cf4b735eb4.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_22098ae468b81cdca33a56cf4b735eb4.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_95a69db15f51eb0a6a161648b9f7b97a.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_95a69db15f51eb0a6a161648b9f7b97a.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_fa11e6a12fc5a4a2da08deb6611bd72f.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_fa11e6a12fc5a4a2da08deb6611bd72f.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_f9cf4158e66927f2b7de4981a73fdf67.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_f9cf4158e66927f2b7de4981a73fdf67.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_b1ca98e49ebc0e47b43a51d123932037.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_b1ca98e49ebc0e47b43a51d123932037.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_91125420bdfc115385f19371db8f5cd6.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_91125420bdfc115385f19371db8f5cd6.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_c99e45648aeac90098c714541ce029a2.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_c99e45648aeac90098c714541ce029a2.jpg already downloaded
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F79%252Fc979ac1e4f150bc14c2e9f932a0157d7%252Fpa%252FZK08136_c176cad508d253147fcf2b1d90e73cde.jpg%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_c176cad508d253147fcf2b1d90e73cde.jpg already downloaded
2026-03-29 07:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b, identifier: ZK08136
2026-03-29 07:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98645f04-9597-5f2a-8753-b69d88860c26 with identifier: UP89204
2026-03-29 07:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98645f04-9597-5f2a-8753-b69d88860c26 with identifier: UP89204
2026-03-29 07:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98645f04-9597-5f2a-8753-b69d88860c26 with identifier: UP89204 to the API
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UP89204>
{'auction_title': '',
'c_o_2_emission_value': 172,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:37:16Z',
'fuel_type': 'petrol',
'id': '98645f04-9597-5f2a-8753-b69d88860c26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP89204',
'listing': 'auction',
'location': 'DE, Ellerau',
'make': 'BMW',
'model': '5er',
'odometer': 160158,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_c51bb78725990b6cc8b4533e1baf67bd.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_1ac569270098e0c6d4ff3b1288739fd3.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_4f438a5e0798535e5ca30ac48f885cbe.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_8668610b4f97e7f5d80b3ccadbe55d53.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_1d50bd98cbb72a9efd4c20ac0efcd4ad.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_6fc9179bb60d2c907d980bfe97f4b5f0.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_7b906e6235621bf046f5254b3e10d5b8.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_07a6d63ffdbdf0315e2af3435c229f8f.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_833e406234f02b95e9334406c78f0527.jpg',
'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_dbe900559386f1e4eb68749daf0ca41c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_c51bb78725990b6cc8b4533e1baf67bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_1ac569270098e0c6d4ff3b1288739fd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_4f438a5e0798535e5ca30ac48f885cbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_8668610b4f97e7f5d80b3ccadbe55d53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_1d50bd98cbb72a9efd4c20ac0efcd4ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_6fc9179bb60d2c907d980bfe97f4b5f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_7b906e6235621bf046f5254b3e10d5b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_07a6d63ffdbdf0315e2af3435c229f8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_833e406234f02b95e9334406c78f0527.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98645f04-9597-5f2a-8753-b69d88860c26/98645f04-9597-5f2a-8753-b69d88860c26_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/c1/17c1ddfbb7714cb541496740d0f37bd1/pa/UP89204_dbe900559386f1e4eb68749daf0ca41c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 540i xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2017}
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP89204%27 HTTP/1.1" 200 None
2026-03-29 07:31:16 [auto1.de] INFO: Saving data for UP89204: {'created_time': 1774769476.927756, 'last_price_update_time': 1774769476.927767, 'auction_closing_time': 1774885036.0}
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP89204') HTTP/1.1" 204 0
2026-03-29 07:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with identifier: ZK08136
2026-03-29 07:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with identifier: ZK08136
2026-03-29 07:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f69c0ca-4e12-5d01-94fa-2278c4f64e7b with identifier: ZK08136 to the API
2026-03-29 07:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK08136>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:00:15Z',
'fuel_type': 'petrol',
'id': '4f69c0ca-4e12-5d01-94fa-2278c4f64e7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK08136',
'listing': 'auction',
'location': 'DE, Dortmund',
'make': 'Audi',
'model': 'A6',
'odometer': 50211,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_8434e812eb77da4d0ba4987703c4a314.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_6948c9986c9dbcd3cbb3036eca20f453.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_22098ae468b81cdca33a56cf4b735eb4.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_95a69db15f51eb0a6a161648b9f7b97a.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_fa11e6a12fc5a4a2da08deb6611bd72f.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_f9cf4158e66927f2b7de4981a73fdf67.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_b1ca98e49ebc0e47b43a51d123932037.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_91125420bdfc115385f19371db8f5cd6.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_c99e45648aeac90098c714541ce029a2.jpg',
'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_c176cad508d253147fcf2b1d90e73cde.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_8434e812eb77da4d0ba4987703c4a314.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_6948c9986c9dbcd3cbb3036eca20f453.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_22098ae468b81cdca33a56cf4b735eb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_95a69db15f51eb0a6a161648b9f7b97a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_fa11e6a12fc5a4a2da08deb6611bd72f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_f9cf4158e66927f2b7de4981a73fdf67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_b1ca98e49ebc0e47b43a51d123932037.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_91125420bdfc115385f19371db8f5cd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_c99e45648aeac90098c714541ce029a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f69c0ca-4e12-5d01-94fa-2278c4f64e7b/4f69c0ca-4e12-5d01-94fa-2278c4f64e7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/79/c979ac1e4f150bc14c2e9f932a0157d7/pa/ZK08136_c176cad508d253147fcf2b1d90e73cde.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 55 TFSI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2026-03-29 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-29 07:31:17 [auto1.de] INFO: Saving data for ZK08136: {'created_time': 1774769477.361849, 'last_price_update_time': 1774769477.361858, 'auction_closing_time': 1774882815.0}
2026-03-29 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK08136') HTTP/1.1" 204 0
2026-03-29 07:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:18 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 6236 | hits on page: 40
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN60503%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for BN60503: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG41279%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for BG41279: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND89828%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for ND89828: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for CK62820: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for FC82221: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for MF60875: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for KT60854: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for MG42603: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for FK12887: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for CH93645: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for JP33538: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for YT05280: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for RF07068: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-29 07:31:18 [auto1.de] INFO: Scrape type for MU49508: 0
2026-03-29 07:31:18 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-29 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-29 07:31:19 [auto1.de] INFO: Scrape type for KD86114: 0
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-29 07:31:19 [auto1.de] INFO: Scrape type for EF75873: 0
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-29 07:31:19 [auto1.de] INFO: Scrape type for HZ55109: 0
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-29 07:31:19 [auto1.de] INFO: Scrape type for UR98067: 0
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-29 07:31:19 [auto1.de] INFO: Scrape type for CX74060: 0
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-29 07:31:19 [auto1.de] INFO: Scrape type for LA18154: 0
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-29 07:31:19 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-29 07:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:20 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 6236 | hits on page: 40
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for CW95568: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for GD26044: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for EE96817: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for NH06338: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for MF86039: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for SJ64604: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for DT57257: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for VT63649: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for JX79740: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for FR69109: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for BS19118: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for SL92984: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for GH39731: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for SN42334: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for NV30450: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for ZW50012: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for AB49133: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for KB67170: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for KF93262: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for BP80209: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-29 07:31:20 [auto1.de] INFO: Scrape type for FR18143: 0
2026-03-29 07:31:20 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-29 07:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:21 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 6236 | hits on page: 40
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for WF13702: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for HH06006: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for LU46217: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for DC32299: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for ZM10504: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for NA60022: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for CH24864: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for AK26500: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for JL32962: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for UN88738: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for TV18525: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for MU81714: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for ZL07582: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for PW12377: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for RD52099: 0
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-29 07:31:21 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-29 07:31:21 [auto1.de] INFO: Scrape type for CX30934: 0
2026-03-29 07:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:22 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 6236 | hits on page: 40
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-29 07:31:22 [auto1.de] INFO: Scrape type for KT37105: 0
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-29 07:31:22 [auto1.de] INFO: Scrape type for SS07399: 0
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-29 07:31:22 [auto1.de] INFO: Scrape type for RR54011: 0
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-29 07:31:22 [auto1.de] INFO: Scrape type for JL12737: 0
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-29 07:31:22 [auto1.de] INFO: Scrape type for KP96972: 0
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-29 07:31:22 [auto1.de] INFO: Scrape type for YW59624: 0
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-29 07:31:22 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-29 07:31:22 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-29 07:31:22 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for NX68514: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for DW75956: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for DS69815: 2
2026-03-29 07:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-29 07:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with scrape type 2
2026-03-29 07:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with scrape type 2
2026-03-29 07:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 768d5fd6-295d-5f44-9d3a-f2841abe95e3, identifier: DS69815
2026-03-29 07:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-29 07:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815
2026-03-29 07:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 768d5fd6-295d-5f44-9d3a-f2841abe95e3 with identifier: DS69815 to the API
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 525,
'expiration_date': '2026-03-30T15:07:08Z',
'fuel_type': 'petrol',
'id': '768d5fd6-295d-5f44-9d3a-f2841abe95e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS69815',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 94482,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-11',
'seller_name': None,
'title': 'Land Rover Range Rover Sport 5.0 V8 Kompressor Autobiography '
'Dynamic',
'transmission': 'automatic',
'trim': 'Autobiography Dynamic',
'year': 2019}
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Saving data for DS69815: {'auction_closing_time': 1774883228.0, 'created_time': 1774550472.546837, 'last_price_update_time': 1774769483.703221}
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS69815') HTTP/1.1" 204 0
2026-03-29 07:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for AR05539: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for TF63689: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-29 07:31:23 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-29 07:31:23 [auto1.de] INFO: Scrape type for YD12579: 2
2026-03-29 07:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-29 07:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with scrape type 2
2026-03-29 07:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with scrape type 2
2026-03-29 07:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26, identifier: YD12579
2026-03-29 07:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-29 07:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579
2026-03-29 07:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26 with identifier: YD12579 to the API
2026-03-29 07:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:41:53Z',
'fuel_type': 'petrol',
'id': '2a8a1ff8-e0ec-54f7-ac8b-e6d7bc8b0c26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD12579',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 64302,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-18',
'seller_name': None,
'title': 'Hyundai ix35 2.0 Comfort AWD',
'transmission': 'automatic',
'trim': 'Comfort AWD',
'year': 2011}
2026-03-29 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-29 07:31:24 [auto1.de] INFO: Saving data for YD12579: {'auction_closing_time': 1774885313.0, 'created_time': 1774551513.529619, 'last_price_update_time': 1774769484.425488}
2026-03-29 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD12579') HTTP/1.1" 204 0
2026-03-29 07:31:24 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-29 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-29 07:31:24 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-29 07:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:25 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 6238 | hits on page: 40
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-29 07:31:25 [auto1.de] INFO: Scrape type for YD12579: 0
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-29 07:31:25 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-29 07:31:25 [auto1.de] INFO: Scrape type for NU91903: 2
2026-03-29 07:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-29 07:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9264353-4757-570c-80f7-56324704a887 with scrape type 2
2026-03-29 07:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9264353-4757-570c-80f7-56324704a887 with scrape type 2
2026-03-29 07:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9264353-4757-570c-80f7-56324704a887, identifier: NU91903
2026-03-29 07:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-29 07:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903
2026-03-29 07:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9264353-4757-570c-80f7-56324704a887 with identifier: NU91903 to the API
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:19:57Z',
'fuel_type': 'diesel',
'id': 'a9264353-4757-570c-80f7-56324704a887',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU91903',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 294162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1996-06-30',
'seller_name': None,
'title': 'Ford Ranger 2.5 TD Extrakabine 4x4',
'transmission': 'manual',
'trim': 'Extrakabine 4x4',
'year': 1996}
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-29 07:31:25 [auto1.de] INFO: Saving data for NU91903: {'auction_closing_time': 1774883997.0, 'created_time': 1774552774.43453, 'last_price_update_time': 1774769485.926413}
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU91903') HTTP/1.1" 204 0
2026-03-29 07:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-29 07:31:25 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-29 07:31:25 [auto1.de] INFO: Scrape type for BE44691: 0
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-29 07:31:25 [auto1.de] INFO: Scrape type for ZK29983: 0
2026-03-29 07:31:25 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for FC63717: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for UP80660: 2
2026-03-29 07:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-29 07:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfd998f-1017-5859-88b0-899bfbf83397 with scrape type 2
2026-03-29 07:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cfd998f-1017-5859-88b0-899bfbf83397 with scrape type 2
2026-03-29 07:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cfd998f-1017-5859-88b0-899bfbf83397, identifier: UP80660
2026-03-29 07:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-29 07:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660
2026-03-29 07:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cfd998f-1017-5859-88b0-899bfbf83397 with identifier: UP80660 to the API
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:41:06Z',
'fuel_type': 'diesel',
'id': '8cfd998f-1017-5859-88b0-899bfbf83397',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP80660',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 121243,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi Vision 4WD',
'transmission': 'automatic',
'trim': 'Vision 4WD',
'year': 2019}
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Saving data for UP80660: {'auction_closing_time': 1774885266.0, 'created_time': 1774550538.583381, 'last_price_update_time': 1774769486.546075}
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP80660') HTTP/1.1" 204 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for TU49821: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-29 07:31:26 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-29 07:31:26 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-29 07:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:27 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 6239 | hits on page: 40
2026-03-29 07:31:27 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-29 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-29 07:31:27 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-29 07:31:27 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-29 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-29 07:31:27 [auto1.de] INFO: Scrape type for JE51939: 2
2026-03-29 07:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-29 07:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648b4ca1-e5c9-55db-893e-80ab38c67e99 with scrape type 2
2026-03-29 07:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648b4ca1-e5c9-55db-893e-80ab38c67e99 with scrape type 2
2026-03-29 07:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 648b4ca1-e5c9-55db-893e-80ab38c67e99, identifier: JE51939
2026-03-29 07:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-29 07:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939
2026-03-29 07:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 648b4ca1-e5c9-55db-893e-80ab38c67e99 with identifier: JE51939 to the API
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:24:49Z',
'fuel_type': 'hybrid',
'id': '648b4ca1-e5c9-55db-893e-80ab38c67e99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE51939',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 30566,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-23',
'seller_name': None,
'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
'transmission': 'automatic',
'trim': 'VZ',
'year': 2022}
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-29 07:31:28 [auto1.de] INFO: Saving data for JE51939: {'auction_closing_time': 1774884289.0, 'created_time': 1774550888.486793, 'last_price_update_time': 1774769488.226487}
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE51939') HTTP/1.1" 204 0
2026-03-29 07:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:28 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-29 07:31:28 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-29 07:31:28 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-29 07:31:28 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-29 07:31:28 [auto1.de] INFO: Scrape type for CR11100: 0
2026-03-29 07:31:28 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-29 07:31:28 [auto1.de] INFO: Scrape type for WN56158: 0
2026-03-29 07:31:28 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-29 07:31:28 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-29 07:31:28 [auto1.de] INFO: Scrape type for KC39120: 2
2026-03-29 07:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-29 07:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with scrape type 2
2026-03-29 07:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with scrape type 2
2026-03-29 07:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a, identifier: KC39120
2026-03-29 07:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-29 07:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120
2026-03-29 07:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f1e3fdb-040b-5ad2-8326-bad3e4662b1a with identifier: KC39120 to the API
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:28:02Z',
'fuel_type': 'petrol',
'id': '0f1e3fdb-040b-5ad2-8326-bad3e4662b1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC39120',
'listing': 'auction',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 84743,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-12',
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
'transmission': 'manual',
'trim': 'INNOVATION',
'year': 2019}
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-29 07:31:28 [auto1.de] INFO: Saving data for KC39120: {'auction_closing_time': 1774884482.0, 'created_time': 1774551862.836859, 'last_price_update_time': 1774769488.782415}
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC39120') HTTP/1.1" 204 0
2026-03-29 07:31:28 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-29 07:31:28 [auto1.de] INFO: Scrape type for LM88961: 2
2026-03-29 07:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-29 07:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67eb503-4833-5bdc-bfbe-9159a5046b2d with scrape type 2
2026-03-29 07:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67eb503-4833-5bdc-bfbe-9159a5046b2d with scrape type 2
2026-03-29 07:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d67eb503-4833-5bdc-bfbe-9159a5046b2d, identifier: LM88961
2026-03-29 07:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-29 07:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961
2026-03-29 07:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d67eb503-4833-5bdc-bfbe-9159a5046b2d with identifier: LM88961 to the API
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:55:01Z',
'fuel_type': 'petrol',
'id': 'd67eb503-4833-5bdc-bfbe-9159a5046b2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM88961',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 159693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-26',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-29 07:31:29 [auto1.de] INFO: Saving data for LM88961: {'auction_closing_time': 1774886101.0, 'created_time': 1774552892.837492, 'last_price_update_time': 1774769489.221914}
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM88961') HTTP/1.1" 204 0
2026-03-29 07:31:29 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-29 07:31:29 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-29 07:31:29 [auto1.de] INFO: Scrape type for AN54197: 2
2026-03-29 07:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-29 07:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31358549-8be4-5779-90bf-bb86c234c591 with scrape type 2
2026-03-29 07:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31358549-8be4-5779-90bf-bb86c234c591 with scrape type 2
2026-03-29 07:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31358549-8be4-5779-90bf-bb86c234c591, identifier: AN54197
2026-03-29 07:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-29 07:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197
2026-03-29 07:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31358549-8be4-5779-90bf-bb86c234c591 with identifier: AN54197 to the API
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 450,
'expiration_date': '2026-03-30T15:46:19Z',
'fuel_type': 'petrol',
'id': '31358549-8be4-5779-90bf-bb86c234c591',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN54197',
'listing': 'auction',
'make': 'Audi',
'model': 'RS 4',
'odometer': 120286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-31',
'seller_name': None,
'title': 'Audi RS 4 2.9 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-29 07:31:29 [auto1.de] INFO: Saving data for AN54197: {'auction_closing_time': 1774885579.0, 'created_time': 1773223317.122125, 'last_price_update_time': 1774769489.694693}
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN54197') HTTP/1.1" 204 0
2026-03-29 07:31:29 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-29 07:31:29 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-29 07:31:29 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-29 07:31:29 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-29 07:31:29 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-29 07:31:29 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-29 07:31:29 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-29 07:31:29 [auto1.de] INFO: Scrape type for HW22525: 2
2026-03-29 07:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-29 07:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with scrape type 2
2026-03-29 07:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with scrape type 2
2026-03-29 07:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4, identifier: HW22525
2026-03-29 07:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-29 07:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525
2026-03-29 07:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a0f6238-c86e-58c2-b7a9-4cd9787872e4 with identifier: HW22525 to the API
2026-03-29 07:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:35:38Z',
'fuel_type': 'diesel',
'id': '5a0f6238-c86e-58c2-b7a9-4cd9787872e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW22525',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 257059,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2008}
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Saving data for HW22525: {'auction_closing_time': 1774884938.0, 'created_time': 1774550699.773191, 'last_price_update_time': 1774769490.185452}
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW22525') HTTP/1.1" 204 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for UY73943: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for TN59671: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for YS06113: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for VX34650: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-29 07:31:30 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Scrape type for UN58886: 2
2026-03-29 07:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-29 07:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0836e142-c706-50e8-97c6-715cd094342e with scrape type 2
2026-03-29 07:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0836e142-c706-50e8-97c6-715cd094342e with scrape type 2
2026-03-29 07:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0836e142-c706-50e8-97c6-715cd094342e, identifier: UN58886
2026-03-29 07:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-29 07:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886
2026-03-29 07:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0836e142-c706-50e8-97c6-715cd094342e with identifier: UN58886 to the API
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:48:04Z',
'fuel_type': 'petrol',
'id': '0836e142-c706-50e8-97c6-715cd094342e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN58886',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 113829,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-23',
'seller_name': None,
'title': 'Audi A1 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2012}
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-29 07:31:30 [auto1.de] INFO: Saving data for UN58886: {'auction_closing_time': 1774885684.0, 'created_time': 1774589450.978319, 'last_price_update_time': 1774769490.890838}
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN58886') HTTP/1.1" 204 0
2026-03-29 07:31:31 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-29 07:31:31 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-29 07:31:31 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-29 07:31:31 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-29 07:31:31 [auto1.de] INFO: Scrape type for JN76212: 2
2026-03-29 07:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-29 07:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with scrape type 2
2026-03-29 07:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with scrape type 2
2026-03-29 07:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f9984f-742a-51a3-a9f2-7a2c07858cd7, identifier: JN76212
2026-03-29 07:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-29 07:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212
2026-03-29 07:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f9984f-742a-51a3-a9f2-7a2c07858cd7 with identifier: JN76212 to the API
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:38:17Z',
'fuel_type': 'petrol',
'id': '10f9984f-742a-51a3-a9f2-7a2c07858cd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN76212',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 88108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-18',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2019}
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-29 07:31:31 [auto1.de] INFO: Saving data for JN76212: {'auction_closing_time': 1774885097.0, 'created_time': 1774552713.299455, 'last_price_update_time': 1774769491.893525}
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN76212') HTTP/1.1" 204 0
2026-03-29 07:31:31 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-29 07:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:32 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 6242 | hits on page: 40
2026-03-29 07:31:32 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-29 07:31:32 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-29 07:31:32 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-29 07:31:32 [auto1.de] INFO: Scrape type for JN76212: 0
2026-03-29 07:31:32 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-29 07:31:32 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-29 07:31:32 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-29 07:31:32 [auto1.de] INFO: Scrape type for TF08287: 2
2026-03-29 07:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-29 07:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f2d600-0ecc-591c-8871-98bb0a62dfaf with scrape type 2
2026-03-29 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f2d600-0ecc-591c-8871-98bb0a62dfaf with scrape type 2
2026-03-29 07:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48f2d600-0ecc-591c-8871-98bb0a62dfaf, identifier: TF08287
2026-03-29 07:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-29 07:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287
2026-03-29 07:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48f2d600-0ecc-591c-8871-98bb0a62dfaf with identifier: TF08287 to the API
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:00:10Z',
'fuel_type': 'petrol',
'id': '48f2d600-0ecc-591c-8871-98bb0a62dfaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF08287',
'listing': 'auction',
'make': 'Audi',
'model': 'A2',
'odometer': 247755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-08-14',
'seller_name': None,
'title': 'Audi A2 1.4',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-29 07:31:32 [auto1.de] INFO: Saving data for TF08287: {'auction_closing_time': 1774882810.0, 'created_time': 1774550473.956987, 'last_price_update_time': 1774769492.966035}
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF08287') HTTP/1.1" 204 0
2026-03-29 07:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:32 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-29 07:31:32 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-29 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for TU29288: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for MG37810: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for BY58400: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for DJ32425: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for DV41377: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for ZM52655: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for BB33034: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-29 07:31:33 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-29 07:31:33 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-29 07:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:34 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 6242 | hits on page: 40
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-29 07:31:34 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-29 07:31:34 [auto1.de] INFO: Scrape type for JV22464: 0
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-29 07:31:34 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-29 07:31:34 [auto1.de] INFO: Scrape type for GY48177: 0
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-29 07:31:34 [auto1.de] INFO: Scrape type for XM82116: 2
2026-03-29 07:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-29 07:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca2bf380-4b4f-5d58-98f9-2209433faafb with scrape type 2
2026-03-29 07:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca2bf380-4b4f-5d58-98f9-2209433faafb with scrape type 2
2026-03-29 07:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca2bf380-4b4f-5d58-98f9-2209433faafb, identifier: XM82116
2026-03-29 07:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-29 07:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116
2026-03-29 07:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca2bf380-4b4f-5d58-98f9-2209433faafb with identifier: XM82116 to the API
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:07:02Z',
'fuel_type': 'diesel',
'id': 'ca2bf380-4b4f-5d58-98f9-2209433faafb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM82116',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 227755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-05',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2016}
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-29 07:31:34 [auto1.de] INFO: Saving data for XM82116: {'auction_closing_time': 1774883222.0, 'created_time': 1774551775.279452, 'last_price_update_time': 1774769494.655362}
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM82116') HTTP/1.1" 204 0
2026-03-29 07:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-29 07:31:34 [auto1.de] INFO: Scrape type for SZ74678: 0
2026-03-29 07:31:34 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-29 07:31:34 [auto1.de] INFO: Scrape type for SV18867: 2
2026-03-29 07:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-29 07:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with scrape type 2
2026-03-29 07:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with scrape type 2
2026-03-29 07:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56507ea7-c416-5162-aa4e-18dd3b19e8a1, identifier: SV18867
2026-03-29 07:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-29 07:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867
2026-03-29 07:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56507ea7-c416-5162-aa4e-18dd3b19e8a1 with identifier: SV18867 to the API
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:13:44Z',
'fuel_type': 'diesel',
'id': '56507ea7-c416-5162-aa4e-18dd3b19e8a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV18867',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 174136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'Renault Kadjar 1.6 dCi Energy Crossborder',
'transmission': 'manual',
'trim': 'Crossborder',
'year': 2017}
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Saving data for SV18867: {'auction_closing_time': 1774883624.0, 'created_time': 1774552831.786501, 'last_price_update_time': 1774769495.251214}
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV18867') HTTP/1.1" 204 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for SL47086: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for EJ65167: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for JR97371: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for VS79881: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for MF41784: 2
2026-03-29 07:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-29 07:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with scrape type 2
2026-03-29 07:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with scrape type 2
2026-03-29 07:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50, identifier: MF41784
2026-03-29 07:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-29 07:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784
2026-03-29 07:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30a7f072-c5cb-5b4b-bb68-02bd8e8aca50 with identifier: MF41784 to the API
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 103,
'expiration_date': '2026-03-30T15:07:16Z',
'fuel_type': 'diesel',
'id': '30a7f072-c5cb-5b4b-bb68-02bd8e8aca50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF41784',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 250128,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-02',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Avantage',
'transmission': 'manual',
'trim': 'Avantage',
'year': 2009}
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Saving data for MF41784: {'auction_closing_time': 1774883236.0, 'created_time': 1773946414.816105, 'last_price_update_time': 1774769495.818692}
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF41784') HTTP/1.1" 204 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for SC06812: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-29 07:31:35 [auto1.de] INFO: Scrape type for RY72669: 0
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-29 07:31:35 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-29 07:31:36 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-29 07:31:36 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-29 07:31:36 [auto1.de] INFO: Scrape type for FK00341: 2
2026-03-29 07:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-29 07:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd37cb63-2730-5a97-ad3c-c132ebb66158 with scrape type 2
2026-03-29 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd37cb63-2730-5a97-ad3c-c132ebb66158 with scrape type 2
2026-03-29 07:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd37cb63-2730-5a97-ad3c-c132ebb66158, identifier: FK00341
2026-03-29 07:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-29 07:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341
2026-03-29 07:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd37cb63-2730-5a97-ad3c-c132ebb66158 with identifier: FK00341 to the API
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:43:46Z',
'fuel_type': 'petrol',
'id': 'bd37cb63-2730-5a97-ad3c-c132ebb66158',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK00341',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 91338,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-03',
'seller_name': None,
'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2017}
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-29 07:31:36 [auto1.de] INFO: Saving data for FK00341: {'auction_closing_time': 1774885426.0, 'created_time': 1774552056.092032, 'last_price_update_time': 1774769496.441737}
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK00341') HTTP/1.1" 204 0
2026-03-29 07:31:36 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-29 07:31:36 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-29 07:31:36 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-29 07:31:36 [auto1.de] INFO: Scrape type for LE46493: 2
2026-03-29 07:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-29 07:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with scrape type 2
2026-03-29 07:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with scrape type 2
2026-03-29 07:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c, identifier: LE46493
2026-03-29 07:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-29 07:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493
2026-03-29 07:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c with identifier: LE46493 to the API
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:44:54Z',
'fuel_type': 'petrol',
'id': '06e7c38f-92b3-5d1f-8d8d-1bd6e2cc967c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE46493',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 139206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-02',
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 Intro Edition 2WD',
'transmission': 'manual',
'trim': 'Intro Edition 2WD',
'year': 2011}
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-29 07:31:36 [auto1.de] INFO: Saving data for LE46493: {'auction_closing_time': 1774885494.0, 'created_time': 1774550436.507507, 'last_price_update_time': 1774769496.878371}
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE46493') HTTP/1.1" 204 0
2026-03-29 07:31:36 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-29 07:31:36 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-29 07:31:36 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-29 07:31:36 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-29 07:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:38 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 6243 | hits on page: 40
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for MX26895: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for LT72401: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for LJ65077: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for SB37681: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for HJ62454: 2
2026-03-29 07:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-29 07:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with scrape type 2
2026-03-29 07:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with scrape type 2
2026-03-29 07:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea, identifier: HJ62454
2026-03-29 07:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-29 07:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454
2026-03-29 07:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fb819b1-bcbb-53c1-9118-e2454fcc35ea with identifier: HJ62454 to the API
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:52:58Z',
'fuel_type': 'petrol',
'id': '0fb819b1-bcbb-53c1-9118-e2454fcc35ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ62454',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 101089,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-02',
'seller_name': None,
'title': 'Hyundai i10 1.0 YES!',
'transmission': 'manual',
'trim': 'YES!',
'year': 2017}
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Saving data for HJ62454: {'auction_closing_time': 1774885978.0, 'created_time': 1774552633.56325, 'last_price_update_time': 1774769498.555643}
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ62454') HTTP/1.1" 204 0
2026-03-29 07:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for PD80009: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for EF82631: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for PL48246: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for BZ96817: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for GE94001: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for CM83282: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-29 07:31:38 [auto1.de] INFO: Scrape type for RS52465: 0
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-29 07:31:38 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-29 07:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:39 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 6245 | hits on page: 40
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-29 07:31:39 [auto1.de] INFO: Scrape type for XW85438: 0
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-29 07:31:39 [auto1.de] INFO: Scrape type for GJ72633: 0
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-29 07:31:39 [auto1.de] INFO: Scrape type for WE78461: 0
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-29 07:31:39 [auto1.de] INFO: Scrape type for BB70854: 0
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-29 07:31:39 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-29 07:31:39 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-29 07:31:39 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-29 07:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for ZM17001: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for KF91285: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for DF17432: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for EN46705: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for WA68072: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for JV32404: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for LC33794: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for HP02844: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-29 07:31:40 [auto1.de] INFO: Scrape type for JY04435: 0
2026-03-29 07:31:40 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-29 07:31:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:41 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 6245 | hits on page: 40
2026-03-29 07:31:41 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-29 07:31:41 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-29 07:31:41 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-29 07:31:41 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-29 07:31:41 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-29 07:31:41 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-29 07:31:41 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-29 07:31:41 [auto1.de] INFO: Scrape type for RD63050: 0
2026-03-29 07:31:41 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-29 07:31:41 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-29 07:31:41 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-29 07:31:41 [auto1.de] INFO: Scrape type for RM28655: 2
2026-03-29 07:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-29 07:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54a8567-4edc-5867-bbbe-2b9e136ad539 with scrape type 2
2026-03-29 07:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c54a8567-4edc-5867-bbbe-2b9e136ad539 with scrape type 2
2026-03-29 07:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c54a8567-4edc-5867-bbbe-2b9e136ad539, identifier: RM28655
2026-03-29 07:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-29 07:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655
2026-03-29 07:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c54a8567-4edc-5867-bbbe-2b9e136ad539 with identifier: RM28655 to the API
2026-03-29 07:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:10:31Z',
'fuel_type': 'petrol',
'id': 'c54a8567-4edc-5867-bbbe-2b9e136ad539',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM28655',
'listing': 'auction',
'make': 'Mazda',
'model': 'MX-5',
'odometer': 62430,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-26',
'seller_name': None,
'title': 'Mazda MX-5 2.0 Sports-Line',
'transmission': 'manual',
'trim': 'Sports-Line',
'year': 2018}
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Saving data for RM28655: {'auction_closing_time': 1774883431.0, 'created_time': 1774552530.58863, 'last_price_update_time': 1774769502.181062}
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM28655') HTTP/1.1" 204 0
2026-03-29 07:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for KC35382: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for WG70910: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for LB57303: 2
2026-03-29 07:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-29 07:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946a967a-ea54-56ac-b5ff-18105f40c9e4 with scrape type 2
2026-03-29 07:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946a967a-ea54-56ac-b5ff-18105f40c9e4 with scrape type 2
2026-03-29 07:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 946a967a-ea54-56ac-b5ff-18105f40c9e4, identifier: LB57303
2026-03-29 07:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-29 07:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303
2026-03-29 07:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 946a967a-ea54-56ac-b5ff-18105f40c9e4 with identifier: LB57303 to the API
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:15:00Z',
'fuel_type': 'diesel',
'id': '946a967a-ea54-56ac-b5ff-18105f40c9e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB57303',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 289870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-31',
'seller_name': None,
'title': 'Volkswagen Sharan 1.9 TDI Trendline 4Motion',
'transmission': 'manual',
'trim': 'Trendline 4Motion',
'year': 2008}
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Saving data for LB57303: {'auction_closing_time': 1774883700.0, 'created_time': 1774552932.056943, 'last_price_update_time': 1774769502.798776}
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB57303') HTTP/1.1" 204 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for VY38504: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-29 07:31:42 [auto1.de] INFO: Scrape type for JH21308: 0
2026-03-29 07:31:42 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-29 07:31:43 [auto1.de] INFO: Scrape type for TB88794: 2
2026-03-29 07:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-29 07:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44db64be-23d1-518b-b6ae-dfbd5dd836ef with scrape type 2
2026-03-29 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44db64be-23d1-518b-b6ae-dfbd5dd836ef with scrape type 2
2026-03-29 07:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44db64be-23d1-518b-b6ae-dfbd5dd836ef, identifier: TB88794
2026-03-29 07:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-29 07:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794
2026-03-29 07:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44db64be-23d1-518b-b6ae-dfbd5dd836ef with identifier: TB88794 to the API
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:48:35Z',
'fuel_type': 'petrol',
'id': '44db64be-23d1-518b-b6ae-dfbd5dd836ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB88794',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 116384,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-25',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2015}
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-29 07:31:43 [auto1.de] INFO: Saving data for TB88794: {'auction_closing_time': 1774885715.0, 'created_time': 1774552630.815968, 'last_price_update_time': 1774769503.46271}
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB88794') HTTP/1.1" 204 0
2026-03-29 07:31:43 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-29 07:31:43 [auto1.de] INFO: Scrape type for FA01437: 0
2026-03-29 07:31:43 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-29 07:31:43 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-29 07:31:43 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-29 07:31:43 [auto1.de] INFO: Scrape type for BB54670: 2
2026-03-29 07:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-29 07:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with scrape type 2
2026-03-29 07:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with scrape type 2
2026-03-29 07:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd, identifier: BB54670
2026-03-29 07:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-29 07:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670
2026-03-29 07:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd with identifier: BB54670 to the API
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:33:38Z',
'fuel_type': 'diesel',
'id': '78e2e6ba-43e4-5fc9-b49c-2fc7cc21d4cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB54670',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 139161,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-18',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-29 07:31:43 [auto1.de] INFO: Saving data for BB54670: {'auction_closing_time': 1774884818.0, 'created_time': 1773344646.450689, 'last_price_update_time': 1774769503.924455}
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB54670') HTTP/1.1" 204 0
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-29 07:31:44 [auto1.de] INFO: Scrape type for XY94981: 0
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-29 07:31:44 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-29 07:31:44 [auto1.de] INFO: Scrape type for DB25597: 0
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-29 07:31:44 [auto1.de] INFO: Scrape type for YZ38333: 0
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-29 07:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:44 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 6246 | hits on page: 40
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-29 07:31:44 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-29 07:31:44 [auto1.de] INFO: Scrape type for GG14507: 0
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-29 07:31:44 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-29 07:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-29 07:31:45 [auto1.de] INFO: Scrape type for VG84958: 2
2026-03-29 07:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-29 07:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64b310b-2d27-529f-bc32-585c17bfedf0 with scrape type 2
2026-03-29 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64b310b-2d27-529f-bc32-585c17bfedf0 with scrape type 2
2026-03-29 07:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e64b310b-2d27-529f-bc32-585c17bfedf0, identifier: VG84958
2026-03-29 07:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-29 07:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958
2026-03-29 07:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e64b310b-2d27-529f-bc32-585c17bfedf0 with identifier: VG84958 to the API
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:41:09Z',
'fuel_type': 'petrol',
'id': 'e64b310b-2d27-529f-bc32-585c17bfedf0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG84958',
'listing': 'auction',
'make': 'Porsche',
'model': 'Boxster',
'odometer': 140213,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-17',
'seller_name': None,
'title': 'Porsche Boxster S',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-29 07:31:45 [auto1.de] INFO: Saving data for VG84958: {'auction_closing_time': 1774885269.0, 'created_time': 1774552137.726342, 'last_price_update_time': 1774769505.415676}
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG84958') HTTP/1.1" 204 0
2026-03-29 07:31:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:45 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-29 07:31:45 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-29 07:31:45 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-29 07:31:45 [auto1.de] INFO: Scrape type for EH25554: 2
2026-03-29 07:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-29 07:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with scrape type 2
2026-03-29 07:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with scrape type 2
2026-03-29 07:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a, identifier: EH25554
2026-03-29 07:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-29 07:31:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554
2026-03-29 07:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e2eed26-73a1-5058-8d45-a0b4e6f62e2a with identifier: EH25554 to the API
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'purple',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:57:39Z',
'fuel_type': 'diesel',
'id': '1e2eed26-73a1-5058-8d45-a0b4e6f62e2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH25554',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai+2',
'odometer': 295931,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-30',
'seller_name': None,
'title': 'Nissan Qashqai+2 1.5 Turbodiesel I-Way',
'transmission': 'manual',
'trim': 'I-Way',
'year': 2011}
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Saving data for EH25554: {'auction_closing_time': 1774886259.0, 'created_time': 1774550524.354712, 'last_price_update_time': 1774769506.079572}
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH25554') HTTP/1.1" 204 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for JT97344: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for WG00954: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for HJ54596: 2
2026-03-29 07:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-29 07:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78dcb082-d16c-5556-aa94-a7fb0d3475ce with scrape type 2
2026-03-29 07:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78dcb082-d16c-5556-aa94-a7fb0d3475ce with scrape type 2
2026-03-29 07:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78dcb082-d16c-5556-aa94-a7fb0d3475ce, identifier: HJ54596
2026-03-29 07:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 07:31:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596
2026-03-29 07:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78dcb082-d16c-5556-aa94-a7fb0d3475ce with identifier: HJ54596 to the API
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:57:23Z',
'fuel_type': 'gas',
'id': '78dcb082-d16c-5556-aa94-a7fb0d3475ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ54596',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 69378,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-16',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2022}
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Saving data for HJ54596: {'auction_closing_time': 1774886243.0, 'created_time': 1774552428.278473, 'last_price_update_time': 1774769506.722495}
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ54596') HTTP/1.1" 204 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for SK99321: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for HJ11294: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-29 07:31:46 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-29 07:31:46 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-29 07:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:47 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 6248 | hits on page: 40
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-29 07:31:47 [auto1.de] INFO: Scrape type for SL53901: 0
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-29 07:31:47 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-29 07:31:47 [auto1.de] INFO: Scrape type for DW94281: 0
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-29 07:31:47 [auto1.de] INFO: Scrape type for VD47640: 0
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-29 07:31:47 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-29 07:31:47 [auto1.de] INFO: Scrape type for UV26569: 2
2026-03-29 07:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-29 07:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52870aa1-64fe-55f8-bcb2-c41fec631421 with scrape type 2
2026-03-29 07:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52870aa1-64fe-55f8-bcb2-c41fec631421 with scrape type 2
2026-03-29 07:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52870aa1-64fe-55f8-bcb2-c41fec631421, identifier: UV26569
2026-03-29 07:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-29 07:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569
2026-03-29 07:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52870aa1-64fe-55f8-bcb2-c41fec631421 with identifier: UV26569 to the API
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:07:12Z',
'fuel_type': 'petrol',
'id': '52870aa1-64fe-55f8-bcb2-c41fec631421',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV26569',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 91359,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-24',
'seller_name': None,
'title': 'Peugeot 107 1.0 Filou',
'transmission': 'manual',
'trim': 'Filou',
'year': 2009}
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Saving data for UV26569: {'auction_closing_time': 1774883232.0, 'created_time': 1774552993.575805, 'last_price_update_time': 1774769508.217827}
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV26569') HTTP/1.1" 204 0
2026-03-29 07:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for KV36004: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for TH75068: 2
2026-03-29 07:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-29 07:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ba38eb-0bd3-55c4-8f67-b4be6553898f with scrape type 2
2026-03-29 07:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ba38eb-0bd3-55c4-8f67-b4be6553898f with scrape type 2
2026-03-29 07:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60ba38eb-0bd3-55c4-8f67-b4be6553898f, identifier: TH75068
2026-03-29 07:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-29 07:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068
2026-03-29 07:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60ba38eb-0bd3-55c4-8f67-b4be6553898f with identifier: TH75068 to the API
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-30T15:50:30Z',
'fuel_type': 'diesel',
'id': '60ba38eb-0bd3-55c4-8f67-b4be6553898f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH75068',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 213073,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-29',
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Saving data for TH75068: {'auction_closing_time': 1774885830.0, 'created_time': 1774552169.193334, 'last_price_update_time': 1774769508.785473}
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH75068') HTTP/1.1" 204 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for JZ96778: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-29 07:31:48 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-29 07:31:48 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-29 07:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:49 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 6248 | hits on page: 40
2026-03-29 07:31:49 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-29 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-29 07:31:49 [auto1.de] INFO: Scrape type for CF84548: 0
2026-03-29 07:31:49 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-29 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-29 07:31:49 [auto1.de] INFO: Scrape type for HE96933: 0
2026-03-29 07:31:49 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-29 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-29 07:31:49 [auto1.de] INFO: Scrape type for JD70113: 2
2026-03-29 07:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-29 07:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66a6e5e4-adf3-5cde-a18a-066d21844c1e with scrape type 2
2026-03-29 07:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66a6e5e4-adf3-5cde-a18a-066d21844c1e with scrape type 2
2026-03-29 07:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66a6e5e4-adf3-5cde-a18a-066d21844c1e, identifier: JD70113
2026-03-29 07:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-29 07:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113
2026-03-29 07:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66a6e5e4-adf3-5cde-a18a-066d21844c1e with identifier: JD70113 to the API
2026-03-29 07:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:57:00Z',
'fuel_type': 'petrol',
'id': '66a6e5e4-adf3-5cde-a18a-066d21844c1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD70113',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 148411,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-27',
'seller_name': None,
'title': 'Mazda 3 2.0 Nakama',
'transmission': 'manual',
'trim': 'Nakama',
'year': 2016}
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Saving data for JD70113: {'auction_closing_time': 1774886220.0, 'created_time': 1774550433.961251, 'last_price_update_time': 1774769510.155303}
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD70113') HTTP/1.1" 204 0
2026-03-29 07:31:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for TD06456: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for XT71149: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for JV77194: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for DG73044: 2
2026-03-29 07:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-29 07:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f966bfbd-bd95-5299-848b-f2633a8cb12a with scrape type 2
2026-03-29 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f966bfbd-bd95-5299-848b-f2633a8cb12a with scrape type 2
2026-03-29 07:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f966bfbd-bd95-5299-848b-f2633a8cb12a, identifier: DG73044
2026-03-29 07:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-29 07:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044
2026-03-29 07:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f966bfbd-bd95-5299-848b-f2633a8cb12a with identifier: DG73044 to the API
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:05:43Z',
'fuel_type': 'petrol',
'id': 'f966bfbd-bd95-5299-848b-f2633a8cb12a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG73044',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 48162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-09',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2022}
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Saving data for DG73044: {'auction_closing_time': 1774883143.0, 'created_time': 1774552677.139737, 'last_price_update_time': 1774769510.755968}
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG73044') HTTP/1.1" 204 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for XN26589: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: US43373
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for SA82608: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for WG96363: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for ZC62608: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-29 07:31:50 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-29 07:31:50 [auto1.de] INFO: Scrape type for CP99772: 2
2026-03-29 07:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-29 07:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with scrape type 2
2026-03-29 07:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with scrape type 2
2026-03-29 07:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c, identifier: CP99772
2026-03-29 07:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-29 07:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772
2026-03-29 07:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c with identifier: CP99772 to the API
2026-03-29 07:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:34:32Z',
'fuel_type': 'petrol',
'id': '6706c4ae-ae69-5dbd-b00a-7b6bffa4c55c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP99772',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 88770,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-11',
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-29 07:31:51 [auto1.de] INFO: Saving data for CP99772: {'auction_closing_time': 1774884872.0, 'created_time': 1774552784.53474, 'last_price_update_time': 1774769511.410212}
2026-03-29 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP99772') HTTP/1.1" 204 0
2026-03-29 07:31:51 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-29 07:31:51 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-29 07:31:51 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-29 07:31:51 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-29 07:31:51 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-29 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-29 07:31:51 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-29 07:31:51 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-29 07:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:52 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 6248 | hits on page: 40
2026-03-29 07:31:52 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-29 07:31:52 [auto1.de] INFO: Scrape type for VJ44121: 0
2026-03-29 07:31:52 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-29 07:31:52 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-29 07:31:52 [auto1.de] INFO: Scrape type for SY16661: 2
2026-03-29 07:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-29 07:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with scrape type 2
2026-03-29 07:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with scrape type 2
2026-03-29 07:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa1ebb92-e712-5112-9e0a-45d63c1d0a53, identifier: SY16661
2026-03-29 07:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-29 07:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661
2026-03-29 07:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa1ebb92-e712-5112-9e0a-45d63c1d0a53 with identifier: SY16661 to the API
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:32:24Z',
'fuel_type': 'petrol',
'id': 'fa1ebb92-e712-5112-9e0a-45d63c1d0a53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY16661',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 154075,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-13',
'seller_name': None,
'title': 'Opel Insignia 1.6 SIDI Turbo Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2015}
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-29 07:31:52 [auto1.de] INFO: Saving data for SY16661: {'auction_closing_time': 1774884744.0, 'created_time': 1774552932.970288, 'last_price_update_time': 1774769512.993176}
2026-03-29 07:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY16661') HTTP/1.1" 204 0
2026-03-29 07:31:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for PW56805: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for GF62239: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for EL73218: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for BV55429: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for EC33073: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for ZW06761: 2
2026-03-29 07:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-29 07:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7889c2a0-81fd-5255-818c-e6b29011217a with scrape type 2
2026-03-29 07:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7889c2a0-81fd-5255-818c-e6b29011217a with scrape type 2
2026-03-29 07:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7889c2a0-81fd-5255-818c-e6b29011217a, identifier: ZW06761
2026-03-29 07:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-29 07:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761
2026-03-29 07:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7889c2a0-81fd-5255-818c-e6b29011217a with identifier: ZW06761 to the API
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:33:33Z',
'fuel_type': 'diesel',
'id': '7889c2a0-81fd-5255-818c-e6b29011217a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW06761',
'listing': 'auction',
'make': 'Fiat',
'model': 'Scudo',
'odometer': 242856,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-03',
'seller_name': None,
'title': 'Fiat Scudo 2.0 JTDM 10 SX L1H1 120 Multijet',
'transmission': 'manual',
'trim': '10 SX L1H1 120 Multijet',
'year': 2010}
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Saving data for ZW06761: {'auction_closing_time': 1774884813.0, 'created_time': 1774552694.371132, 'last_price_update_time': 1774769513.645029}
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW06761') HTTP/1.1" 204 0
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-29 07:31:53 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-29 07:31:53 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-29 07:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:54 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 6249 | hits on page: 40
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for KS23837: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for CR29385: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for SS89253: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for HV14674: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for AE42693: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for DN26053: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-29 07:31:54 [auto1.de] INFO: Scrape type for PC60624: 0
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-29 07:31:54 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-29 07:31:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:56 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 6250 | hits on page: 40
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for VB62953: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for WS48624: 2
2026-03-29 07:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-29 07:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f182aa22-66f8-548c-8487-91e34763c870 with scrape type 2
2026-03-29 07:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f182aa22-66f8-548c-8487-91e34763c870 with scrape type 2
2026-03-29 07:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f182aa22-66f8-548c-8487-91e34763c870, identifier: WS48624
2026-03-29 07:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-29 07:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624
2026-03-29 07:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f182aa22-66f8-548c-8487-91e34763c870 with identifier: WS48624 to the API
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:34:42Z',
'fuel_type': 'diesel',
'id': 'f182aa22-66f8-548c-8487-91e34763c870',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS48624',
'listing': 'auction',
'make': 'Fiat',
'model': 'Scudo',
'odometer': 337077,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-30',
'seller_name': None,
'title': 'Fiat Scudo 1.6 JTDM 10 SX L1H1 90 Multijet',
'transmission': 'manual',
'trim': '10 SX L1H1 90 Multijet',
'year': 2010}
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Saving data for WS48624: {'auction_closing_time': 1774884882.0, 'created_time': 1774553009.584312, 'last_price_update_time': 1774769516.746286}
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS48624') HTTP/1.1" 204 0
2026-03-29 07:31:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for LC91854: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for SY85938: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for UB45914: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for ZM88975: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for WN92632: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-29 07:31:56 [auto1.de] INFO: Scrape type for LJ18760: 0
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-29 07:31:56 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-29 07:31:57 [auto1.de] INFO: Scrape type for EU98596: 2
2026-03-29 07:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-29 07:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with scrape type 2
2026-03-29 07:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with scrape type 2
2026-03-29 07:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148, identifier: EU98596
2026-03-29 07:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-29 07:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596
2026-03-29 07:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e70c1c9-40a0-5ab5-9cc7-470279c3c148 with identifier: EU98596 to the API
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 178,
'expiration_date': '2026-03-30T15:53:57Z',
'fuel_type': 'diesel',
'id': '8e70c1c9-40a0-5ab5-9cc7-470279c3c148',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU98596',
'listing': 'auction',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 181848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-28',
'seller_name': None,
'title': 'Fiat Ducato 2.3 Multijet L2H2 RS: 3450 mm',
'transmission': 'automatic',
'trim': 'L2H2 RS: 3450 mm',
'year': 2020}
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-29 07:31:57 [auto1.de] INFO: Saving data for EU98596: {'auction_closing_time': 1774886037.0, 'created_time': 1773946413.761746, 'last_price_update_time': 1774769517.413428}
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU98596') HTTP/1.1" 204 0
2026-03-29 07:31:57 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-29 07:31:57 [auto1.de] INFO: Scrape type for YH81029: 0
2026-03-29 07:31:57 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-29 07:31:57 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-29 07:31:57 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-29 07:31:57 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-29 07:31:57 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-29 07:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:31:58 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 6251 | hits on page: 40
2026-03-29 07:31:58 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-29 07:31:58 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-29 07:31:58 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-29 07:31:58 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-29 07:31:58 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-29 07:31:58 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-29 07:31:58 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-29 07:31:58 [auto1.de] INFO: Scrape type for FD81187: 0
2026-03-29 07:31:58 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-29 07:31:58 [auto1.de] INFO: Scrape type for TD54604: 0
2026-03-29 07:31:58 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-29 07:31:58 [auto1.de] INFO: Scrape type for JM39243: 2
2026-03-29 07:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-29 07:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d008177-ccec-5e27-a287-4eb3f2095452 with scrape type 2
2026-03-29 07:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d008177-ccec-5e27-a287-4eb3f2095452 with scrape type 2
2026-03-29 07:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d008177-ccec-5e27-a287-4eb3f2095452, identifier: JM39243
2026-03-29 07:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-29 07:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243
2026-03-29 07:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d008177-ccec-5e27-a287-4eb3f2095452 with identifier: JM39243 to the API
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:27:12Z',
'fuel_type': 'diesel',
'id': '6d008177-ccec-5e27-a287-4eb3f2095452',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM39243',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 279140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-10',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-29 07:31:58 [auto1.de] INFO: Saving data for JM39243: {'auction_closing_time': 1774884432.0, 'created_time': 1774589461.054211, 'last_price_update_time': 1774769518.965691}
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM39243') HTTP/1.1" 204 0
2026-03-29 07:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-29 07:31:59 [auto1.de] INFO: Scrape type for VH61709: 2
2026-03-29 07:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-29 07:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e457e378-4d4d-59aa-8764-8a46dffa1adf with scrape type 2
2026-03-29 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e457e378-4d4d-59aa-8764-8a46dffa1adf with scrape type 2
2026-03-29 07:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e457e378-4d4d-59aa-8764-8a46dffa1adf, identifier: VH61709
2026-03-29 07:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-29 07:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709
2026-03-29 07:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e457e378-4d4d-59aa-8764-8a46dffa1adf with identifier: VH61709 to the API
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:39:51Z',
'fuel_type': 'petrol',
'id': 'e457e378-4d4d-59aa-8764-8a46dffa1adf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH61709',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 242960,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-27',
'seller_name': None,
'title': 'Ford Focus 1.6 Viva',
'transmission': 'manual',
'trim': 'Viva',
'year': 2010}
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-29 07:31:59 [auto1.de] INFO: Saving data for VH61709: {'auction_closing_time': 1774885191.0, 'created_time': 1773917096.745121, 'last_price_update_time': 1774769519.545773}
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH61709') HTTP/1.1" 204 0
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-29 07:31:59 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-29 07:31:59 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-29 07:31:59 [auto1.de] INFO: Scrape type for SG95649: 0
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-29 07:31:59 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-29 07:31:59 [auto1.de] INFO: Scrape type for RG01801: 2
2026-03-29 07:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-29 07:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fecde1-f447-581f-a0b5-aefa61776a37 with scrape type 2
2026-03-29 07:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fecde1-f447-581f-a0b5-aefa61776a37 with scrape type 2
2026-03-29 07:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fecde1-f447-581f-a0b5-aefa61776a37, identifier: RG01801
2026-03-29 07:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-29 07:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801
2026-03-29 07:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fecde1-f447-581f-a0b5-aefa61776a37 with identifier: RG01801 to the API
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:52:26Z',
'fuel_type': 'diesel',
'id': '47fecde1-f447-581f-a0b5-aefa61776a37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG01801',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 219874,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-17',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline BlueMotion Tech.',
'transmission': 'manual',
'trim': 'Maxi Comfortline BlueMotion Tech.',
'year': 2013}
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Saving data for RG01801: {'auction_closing_time': 1774885946.0, 'created_time': 1774550431.685973, 'last_price_update_time': 1774769520.025009}
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG01801') HTTP/1.1" 204 0
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Scrape type for YA93761: 2
2026-03-29 07:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-29 07:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 258aa3c4-6137-5877-9069-b9a14fa8ce63 with scrape type 2
2026-03-29 07:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 258aa3c4-6137-5877-9069-b9a14fa8ce63 with scrape type 2
2026-03-29 07:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 258aa3c4-6137-5877-9069-b9a14fa8ce63, identifier: YA93761
2026-03-29 07:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-29 07:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761
2026-03-29 07:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 258aa3c4-6137-5877-9069-b9a14fa8ce63 with identifier: YA93761 to the API
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:22:04Z',
'fuel_type': 'petrol',
'id': '258aa3c4-6137-5877-9069-b9a14fa8ce63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA93761',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 238783,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-18',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2018}
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Saving data for YA93761: {'auction_closing_time': 1774884124.0, 'created_time': 1774550490.082061, 'last_price_update_time': 1774769520.624617}
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA93761') HTTP/1.1" 204 0
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Scrape type for GS69685: 0
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Scrape type for SD97689: 0
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-29 07:32:00 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-29 07:32:00 [auto1.de] INFO: Scrape type for ZJ78917: 2
2026-03-29 07:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-29 07:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c307ab0-839c-50fc-b200-ace68ac89656 with scrape type 2
2026-03-29 07:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c307ab0-839c-50fc-b200-ace68ac89656 with scrape type 2
2026-03-29 07:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c307ab0-839c-50fc-b200-ace68ac89656, identifier: ZJ78917
2026-03-29 07:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-29 07:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917
2026-03-29 07:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c307ab0-839c-50fc-b200-ace68ac89656 with identifier: ZJ78917 to the API
2026-03-29 07:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:47:33Z',
'fuel_type': 'diesel',
'id': '5c307ab0-839c-50fc-b200-ace68ac89656',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ78917',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 188156,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-10',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
'transmission': 'automatic',
'trim': 'Standard',
'year': 2005}
2026-03-29 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-29 07:32:01 [auto1.de] INFO: Saving data for ZJ78917: {'auction_closing_time': 1774885653.0, 'created_time': 1774550715.744846, 'last_price_update_time': 1774769521.150369}
2026-03-29 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ78917') HTTP/1.1" 204 0
2026-03-29 07:32:01 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-29 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-29 07:32:01 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-29 07:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:02 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 6252 | hits on page: 40
2026-03-29 07:32:02 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-29 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-29 07:32:02 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-29 07:32:02 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-29 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-29 07:32:02 [auto1.de] INFO: Scrape type for SG28437: 0
2026-03-29 07:32:02 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-29 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-29 07:32:02 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-29 07:32:02 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-29 07:32:02 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-29 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-29 07:32:02 [auto1.de] INFO: Scrape type for AA51921: 2
2026-03-29 07:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-29 07:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32cf3593-42a2-54cf-aeee-6e07c47047ac with scrape type 2
2026-03-29 07:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32cf3593-42a2-54cf-aeee-6e07c47047ac with scrape type 2
2026-03-29 07:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32cf3593-42a2-54cf-aeee-6e07c47047ac, identifier: AA51921
2026-03-29 07:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-29 07:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921
2026-03-29 07:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32cf3593-42a2-54cf-aeee-6e07c47047ac with identifier: AA51921 to the API
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:12:02Z',
'fuel_type': 'diesel',
'id': '32cf3593-42a2-54cf-aeee-6e07c47047ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA51921',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 48182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-15',
'seller_name': None,
'title': 'Ford Transit 1.5 TDCi Kasten Sport Lang',
'transmission': 'manual',
'trim': 'Kasten Sport Lang',
'year': 2017}
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Saving data for AA51921: {'auction_closing_time': 1774883522.0, 'created_time': 1774552732.297613, 'last_price_update_time': 1774769523.304829}
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA51921') HTTP/1.1" 204 0
2026-03-29 07:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for HT62005: 2
2026-03-29 07:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-29 07:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf96e34-ab6c-55a5-a694-b3c1aa150498 with scrape type 2
2026-03-29 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf96e34-ab6c-55a5-a694-b3c1aa150498 with scrape type 2
2026-03-29 07:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abf96e34-ab6c-55a5-a694-b3c1aa150498, identifier: HT62005
2026-03-29 07:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-29 07:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005
2026-03-29 07:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abf96e34-ab6c-55a5-a694-b3c1aa150498 with identifier: HT62005 to the API
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:31Z',
'fuel_type': 'diesel',
'id': 'abf96e34-ab6c-55a5-a694-b3c1aa150498',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT62005',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 88085,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-23',
'seller_name': None,
'title': 'Land Rover Discovery Sport D150 S AWD',
'transmission': 'automatic',
'trim': 'S AWD',
'year': 2020}
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Saving data for HT62005: {'auction_closing_time': 1774885291.0, 'created_time': 1774550647.246186, 'last_price_update_time': 1774769523.754014}
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT62005') HTTP/1.1" 204 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for LU00556: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for NM84530: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for NX86319: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for KY27003: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for WZ51755: 0
2026-03-29 07:32:03 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-29 07:32:03 [auto1.de] INFO: Scrape type for XV87595: 2
2026-03-29 07:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-29 07:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa861509-4fca-5463-aa04-17cd6dea1c8a with scrape type 2
2026-03-29 07:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa861509-4fca-5463-aa04-17cd6dea1c8a with scrape type 2
2026-03-29 07:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa861509-4fca-5463-aa04-17cd6dea1c8a, identifier: XV87595
2026-03-29 07:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-29 07:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595
2026-03-29 07:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa861509-4fca-5463-aa04-17cd6dea1c8a with identifier: XV87595 to the API
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:37:51Z',
'fuel_type': 'petrol',
'id': 'aa861509-4fca-5463-aa04-17cd6dea1c8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV87595',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 51733,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-20',
'seller_name': None,
'title': 'Opel Corsa 1.4 Drive',
'transmission': 'manual',
'trim': 'Drive',
'year': 2016}
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-29 07:32:04 [auto1.de] INFO: Saving data for XV87595: {'auction_closing_time': 1774885071.0, 'created_time': 1774552739.401406, 'last_price_update_time': 1774769524.386255}
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV87595') HTTP/1.1" 204 0
2026-03-29 07:32:04 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-29 07:32:04 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-29 07:32:04 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-29 07:32:04 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-29 07:32:04 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-29 07:32:04 [auto1.de] INFO: Scrape type for KR20197: 2
2026-03-29 07:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-29 07:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with scrape type 2
2026-03-29 07:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with scrape type 2
2026-03-29 07:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38, identifier: KR20197
2026-03-29 07:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-29 07:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197
2026-03-29 07:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ac9c1dc-800d-5013-bff2-8965d9b1bd38 with identifier: KR20197 to the API
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:26:28Z',
'fuel_type': 'petrol',
'id': '8ac9c1dc-800d-5013-bff2-8965d9b1bd38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR20197',
'listing': 'auction',
'make': 'MINI',
'model': 'Cabrio',
'odometer': 97069,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-01',
'seller_name': None,
'title': 'MINI Cabrio Cooper',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-29 07:32:04 [auto1.de] INFO: Saving data for KR20197: {'auction_closing_time': 1774884388.0, 'created_time': 1774553060.659748, 'last_price_update_time': 1774769524.956742}
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR20197') HTTP/1.1" 204 0
2026-03-29 07:32:04 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-29 07:32:04 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-29 07:32:04 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-29 07:32:04 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-29 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-29 07:32:05 [auto1.de] INFO: Scrape type for NT47170: 2
2026-03-29 07:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-29 07:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with scrape type 2
2026-03-29 07:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with scrape type 2
2026-03-29 07:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f80e89de-8bc7-51c8-8078-1bb6d162e8b3, identifier: NT47170
2026-03-29 07:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-29 07:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170
2026-03-29 07:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f80e89de-8bc7-51c8-8078-1bb6d162e8b3 with identifier: NT47170 to the API
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:10:52Z',
'fuel_type': 'diesel',
'id': 'f80e89de-8bc7-51c8-8078-1bb6d162e8b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT47170',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 203812,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-07',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Conceptline',
'transmission': 'manual',
'trim': 'Conceptline',
'year': 2006}
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-29 07:32:05 [auto1.de] INFO: Saving data for NT47170: {'auction_closing_time': 1774883452.0, 'created_time': 1774550531.079701, 'last_price_update_time': 1774769525.396704}
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT47170') HTTP/1.1" 204 0
2026-03-29 07:32:05 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-29 07:32:05 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-29 07:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:06 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 6252 | hits on page: 40
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-29 07:32:06 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-29 07:32:06 [auto1.de] INFO: Scrape type for RN81514: 0
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-29 07:32:06 [auto1.de] INFO: Scrape type for GY96570: 0
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-29 07:32:06 [auto1.de] INFO: Scrape type for UC60552: 2
2026-03-29 07:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-29 07:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with scrape type 2
2026-03-29 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with scrape type 2
2026-03-29 07:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ece0655-13ae-5e38-93cc-8f662eab1ef2, identifier: UC60552
2026-03-29 07:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-29 07:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552
2026-03-29 07:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ece0655-13ae-5e38-93cc-8f662eab1ef2 with identifier: UC60552 to the API
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:24:59Z',
'fuel_type': 'petrol',
'id': '5ece0655-13ae-5e38-93cc-8f662eab1ef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC60552',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 173128,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-28',
'seller_name': None,
'title': "Kia cee'd 1.6 TGDI GT-Challenge",
'transmission': 'manual',
'trim': 'GT-Challenge',
'year': 2017}
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-29 07:32:06 [auto1.de] INFO: Saving data for UC60552: {'auction_closing_time': 1774884299.0, 'created_time': 1774552542.171765, 'last_price_update_time': 1774769526.889457}
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC60552') HTTP/1.1" 204 0
2026-03-29 07:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-29 07:32:06 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for DX68266: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for FY99153: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for MM43491: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for SA10285: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for PG24864: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for LY63644: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for ES42650: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for UE61705: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-29 07:32:07 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 26 pages/min), scraped 132 items (at 64 items/min)
2026-03-29 07:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 07:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:07 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 6252 | hits on page: 40
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-29 07:32:07 [auto1.de] INFO: Scrape type for XR74072: 0
2026-03-29 07:32:07 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for SF00681: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for ZE41577: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for SA81936: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for JE00015: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for UM95943: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for ZS46633: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for JS64432: 2
2026-03-29 07:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-29 07:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7fab7d-aa15-552a-9ec9-f89955258a3c with scrape type 2
2026-03-29 07:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd7fab7d-aa15-552a-9ec9-f89955258a3c with scrape type 2
2026-03-29 07:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd7fab7d-aa15-552a-9ec9-f89955258a3c, identifier: JS64432
2026-03-29 07:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-29 07:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432
2026-03-29 07:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd7fab7d-aa15-552a-9ec9-f89955258a3c with identifier: JS64432 to the API
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:43:42Z',
'fuel_type': 'petrol',
'id': 'cd7fab7d-aa15-552a-9ec9-f89955258a3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS64432',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 122190,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-28',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Saving data for JS64432: {'auction_closing_time': 1774885422.0, 'created_time': 1774552165.266365, 'last_price_update_time': 1774769528.556225}
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS64432') HTTP/1.1" 204 0
2026-03-29 07:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: NG35588
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG35588%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for NG35588: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: US49854
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for UD14847: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for NZ32972: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for ZB74366: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for XR26970: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for VU33733: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-29 07:32:08 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-29 07:32:08 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-29 07:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:10 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 6252 | hits on page: 40
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for TU08005: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for NR35268: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for ML06015: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for TV18739: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for EE77460: 2
2026-03-29 07:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-29 07:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541fd090-9fa2-584e-ad07-6100c00deb31 with scrape type 2
2026-03-29 07:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541fd090-9fa2-584e-ad07-6100c00deb31 with scrape type 2
2026-03-29 07:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541fd090-9fa2-584e-ad07-6100c00deb31, identifier: EE77460
2026-03-29 07:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-29 07:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460
2026-03-29 07:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541fd090-9fa2-584e-ad07-6100c00deb31 with identifier: EE77460 to the API
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:42:27Z',
'fuel_type': 'petrol',
'id': '541fd090-9fa2-584e-ad07-6100c00deb31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE77460',
'listing': 'auction',
'make': 'Smart',
'model': 'forfour',
'odometer': 102839,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-02',
'seller_name': None,
'title': 'Smart forfour 1.0 youngster',
'transmission': 'manual',
'trim': 'youngster',
'year': 2018}
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Saving data for EE77460: {'auction_closing_time': 1774885347.0, 'created_time': 1774552151.520308, 'last_price_update_time': 1774769530.742748}
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE77460') HTTP/1.1" 204 0
2026-03-29 07:32:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for KS26285: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for EG39650: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for XF55006: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for KH46132: 0
2026-03-29 07:32:10 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-29 07:32:10 [auto1.de] INFO: Scrape type for AF88464: 2
2026-03-29 07:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-29 07:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with scrape type 2
2026-03-29 07:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with scrape type 2
2026-03-29 07:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbcac482-a0ce-5797-9f0a-655b7f4cbc26, identifier: AF88464
2026-03-29 07:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-29 07:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464
2026-03-29 07:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbcac482-a0ce-5797-9f0a-655b7f4cbc26 with identifier: AF88464 to the API
2026-03-29 07:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:53:50Z',
'fuel_type': 'petrol',
'id': 'bbcac482-a0ce-5797-9f0a-655b7f4cbc26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF88464',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 155904,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-04',
'seller_name': None,
'title': 'Opel Corsa 1.4 Satellite',
'transmission': 'manual',
'trim': 'Satellite',
'year': 2011}
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-29 07:32:12 [auto1.de] INFO: Saving data for AF88464: {'auction_closing_time': 1774886030.0, 'created_time': 1774550647.661147, 'last_price_update_time': 1774769532.230296}
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF88464') HTTP/1.1" 204 0
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-29 07:32:12 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-29 07:32:12 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-29 07:32:12 [auto1.de] INFO: Scrape type for AA46272: 0
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-29 07:32:12 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-29 07:32:12 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-29 07:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:13 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 6253 | hits on page: 40
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Scrape type for XG77480: 0
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Scrape type for AM78577: 2
2026-03-29 07:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-29 07:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5941aaef-ac49-547c-9e29-fa0d744649d0 with scrape type 2
2026-03-29 07:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5941aaef-ac49-547c-9e29-fa0d744649d0 with scrape type 2
2026-03-29 07:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5941aaef-ac49-547c-9e29-fa0d744649d0, identifier: AM78577
2026-03-29 07:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-29 07:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577
2026-03-29 07:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5941aaef-ac49-547c-9e29-fa0d744649d0 with identifier: AM78577 to the API
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:29:57Z',
'fuel_type': 'diesel',
'id': '5941aaef-ac49-547c-9e29-fa0d744649d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM78577',
'listing': 'auction',
'make': 'Nissan',
'model': 'NV200 Evalia',
'odometer': 218664,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-28',
'seller_name': None,
'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Tekna',
'transmission': 'manual',
'trim': 'Evalia Tekna',
'year': 2014}
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Saving data for AM78577: {'auction_closing_time': 1774884597.0, 'created_time': 1774551452.446005, 'last_price_update_time': 1774769533.789998}
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM78577') HTTP/1.1" 204 0
2026-03-29 07:32:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Scrape type for FR92717: 0
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Scrape type for PW12132: 0
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Scrape type for NT04254: 0
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-29 07:32:13 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-29 07:32:13 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for GV91786: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for JV68921: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for FP33840: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for FE12352: 2
2026-03-29 07:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-29 07:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with scrape type 2
2026-03-29 07:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with scrape type 2
2026-03-29 07:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d9f5f5d-7d0c-549d-9eab-deb833afc929, identifier: FE12352
2026-03-29 07:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-29 07:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352
2026-03-29 07:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d9f5f5d-7d0c-549d-9eab-deb833afc929 with identifier: FE12352 to the API
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:19:09Z',
'fuel_type': 'petrol',
'id': '1d9f5f5d-7d0c-549d-9eab-deb833afc929',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE12352',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 14854,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-23',
'seller_name': None,
'title': 'Abarth 595 1.4 Turbo',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Saving data for FE12352: {'auction_closing_time': 1774883949.0, 'created_time': 1774553037.704881, 'last_price_update_time': 1774769534.517446}
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE12352') HTTP/1.1" 204 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for GH02109: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for LM10122: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for ZE40568: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for VU50436: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for HG45518: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-29 07:32:14 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-29 07:32:14 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-29 07:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:15 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 6255 | hits on page: 40
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for HB62696: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for RE17232: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for GJ82118: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for KE52706: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for FK87284: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for VX13516: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-29 07:32:15 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-29 07:32:15 [auto1.de] INFO: Scrape type for JN34969: 2
2026-03-29 07:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-29 07:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feff33d0-db5a-5395-b461-d90baf06da5e with scrape type 2
2026-03-29 07:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feff33d0-db5a-5395-b461-d90baf06da5e with scrape type 2
2026-03-29 07:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: feff33d0-db5a-5395-b461-d90baf06da5e, identifier: JN34969
2026-03-29 07:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-29 07:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969
2026-03-29 07:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: feff33d0-db5a-5395-b461-d90baf06da5e with identifier: JN34969 to the API
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:40:12Z',
'fuel_type': 'diesel',
'id': 'feff33d0-db5a-5395-b461-d90baf06da5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN34969',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 213374,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-22',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-29 07:32:16 [auto1.de] INFO: Saving data for JN34969: {'auction_closing_time': 1774885212.0, 'created_time': 1774550446.412514, 'last_price_update_time': 1774769536.301968}
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN34969') HTTP/1.1" 204 0
2026-03-29 07:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:16 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-29 07:32:16 [auto1.de] INFO: Scrape type for XZ94866: 2
2026-03-29 07:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-29 07:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fca553d1-f666-5f50-9e7e-ec2e32e44e92 with scrape type 2
2026-03-29 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fca553d1-f666-5f50-9e7e-ec2e32e44e92 with scrape type 2
2026-03-29 07:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fca553d1-f666-5f50-9e7e-ec2e32e44e92, identifier: XZ94866
2026-03-29 07:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-29 07:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866
2026-03-29 07:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fca553d1-f666-5f50-9e7e-ec2e32e44e92 with identifier: XZ94866 to the API
2026-03-29 07:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:23:05Z',
'fuel_type': 'diesel',
'id': 'fca553d1-f666-5f50-9e7e-ec2e32e44e92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ94866',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 210370,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-02-25',
'seller_name': None,
'title': 'Mercedes-Benz Vito 112 CDI',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-29 07:32:17 [auto1.de] INFO: Saving data for XZ94866: {'auction_closing_time': 1774884185.0, 'created_time': 1774551273.716558, 'last_price_update_time': 1774769537.399145}
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ94866') HTTP/1.1" 204 0
2026-03-29 07:32:17 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-29 07:32:17 [auto1.de] INFO: Scrape type for KK19800: 2
2026-03-29 07:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-29 07:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc01c29-9127-57a0-b84a-ed1bd9c15828 with scrape type 2
2026-03-29 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc01c29-9127-57a0-b84a-ed1bd9c15828 with scrape type 2
2026-03-29 07:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc01c29-9127-57a0-b84a-ed1bd9c15828, identifier: KK19800
2026-03-29 07:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 07:32:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800
2026-03-29 07:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc01c29-9127-57a0-b84a-ed1bd9c15828 with identifier: KK19800 to the API
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:57Z',
'fuel_type': 'diesel',
'id': 'edc01c29-9127-57a0-b84a-ed1bd9c15828',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK19800',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 101989,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-16',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TDI Style 4Motion',
'transmission': 'automatic',
'trim': 'Style 4Motion',
'year': 2018}
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-29 07:32:17 [auto1.de] INFO: Saving data for KK19800: {'auction_closing_time': 1774885137.0, 'created_time': 1774552600.644766, 'last_price_update_time': 1774769537.96946}
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK19800') HTTP/1.1" 204 0
2026-03-29 07:32:17 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-29 07:32:17 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-29 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for DV91076: 0
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for EW47494: 2
2026-03-29 07:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-29 07:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0254ced-9dd2-5ce9-b53b-ad62a87b550a with scrape type 2
2026-03-29 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0254ced-9dd2-5ce9-b53b-ad62a87b550a with scrape type 2
2026-03-29 07:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0254ced-9dd2-5ce9-b53b-ad62a87b550a, identifier: EW47494
2026-03-29 07:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-29 07:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-29 07:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494 to the API
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:52:15Z',
'fuel_type': 'petrol',
'id': 'c0254ced-9dd2-5ce9-b53b-ad62a87b550a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW47494',
'listing': 'auction',
'make': 'Opel',
'model': 'Signum',
'odometer': 129008,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-20',
'seller_name': None,
'title': 'Opel Signum 2.2 Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2005}
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Saving data for EW47494: {'auction_closing_time': 1774885935.0, 'created_time': 1773773421.528833, 'last_price_update_time': 1774769538.453301}
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW47494') HTTP/1.1" 204 0
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-29 07:32:18 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Scrape type for RF79085: 2
2026-03-29 07:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-29 07:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff71619-8f0b-5390-9647-6cc527d31ac0 with scrape type 2
2026-03-29 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff71619-8f0b-5390-9647-6cc527d31ac0 with scrape type 2
2026-03-29 07:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ff71619-8f0b-5390-9647-6cc527d31ac0, identifier: RF79085
2026-03-29 07:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-29 07:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085
2026-03-29 07:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ff71619-8f0b-5390-9647-6cc527d31ac0 with identifier: RF79085 to the API
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:27:33Z',
'fuel_type': 'diesel',
'id': '1ff71619-8f0b-5390-9647-6cc527d31ac0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF79085',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 120057,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-24',
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi BOSE-Edition',
'transmission': 'manual',
'trim': 'BOSE-Edition',
'year': 2020}
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-29 07:32:18 [auto1.de] INFO: Saving data for RF79085: {'auction_closing_time': 1774884453.0, 'created_time': 1773946273.632111, 'last_price_update_time': 1774769538.95288}
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF79085') HTTP/1.1" 204 0
2026-03-29 07:32:19 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-29 07:32:19 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-29 07:32:19 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-29 07:32:19 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-29 07:32:19 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-29 07:32:19 [auto1.de] INFO: Scrape type for KX50860: 2
2026-03-29 07:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-29 07:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with scrape type 2
2026-03-29 07:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with scrape type 2
2026-03-29 07:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd, identifier: KX50860
2026-03-29 07:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-29 07:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860
2026-03-29 07:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd with identifier: KX50860 to the API
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:07:38Z',
'fuel_type': 'diesel',
'id': 'f73f3e92-0bc9-52a6-8b57-c3248b1ad2cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX50860',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 229208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-28',
'seller_name': None,
'title': 'Ford Mondeo 2.2 TDCi Titanium S',
'transmission': 'manual',
'trim': 'Titanium S',
'year': 2012}
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-29 07:32:19 [auto1.de] INFO: Saving data for KX50860: {'auction_closing_time': 1774883258.0, 'created_time': 1774552609.02483, 'last_price_update_time': 1774769539.513066}
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX50860') HTTP/1.1" 204 0
2026-03-29 07:32:19 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-29 07:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:20 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 6256 | hits on page: 40
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-29 07:32:20 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-29 07:32:20 [auto1.de] INFO: Scrape type for LK12001: 0
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-29 07:32:20 [auto1.de] INFO: Scrape type for GH47357: 0
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-29 07:32:20 [auto1.de] INFO: Scrape type for RU25678: 0
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-29 07:32:20 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-29 07:32:20 [auto1.de] INFO: Scrape type for GV09290: 2
2026-03-29 07:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-29 07:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c633b2a0-7b9d-5b03-a832-d699cff4719e with scrape type 2
2026-03-29 07:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c633b2a0-7b9d-5b03-a832-d699cff4719e with scrape type 2
2026-03-29 07:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c633b2a0-7b9d-5b03-a832-d699cff4719e, identifier: GV09290
2026-03-29 07:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-29 07:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290
2026-03-29 07:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c633b2a0-7b9d-5b03-a832-d699cff4719e with identifier: GV09290 to the API
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:14:33Z',
'fuel_type': 'petrol',
'id': 'c633b2a0-7b9d-5b03-a832-d699cff4719e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV09290',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 39195,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-09',
'seller_name': None,
'title': 'Dacia Duster 1.6 SCe Ice 4x2',
'transmission': 'manual',
'trim': 'Ice 4x2',
'year': 2016}
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-29 07:32:20 [auto1.de] INFO: Saving data for GV09290: {'auction_closing_time': 1774883673.0, 'created_time': 1773946114.099924, 'last_price_update_time': 1774769540.865928}
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV09290') HTTP/1.1" 204 0
2026-03-29 07:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Scrape type for KL90594: 2
2026-03-29 07:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-29 07:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7387eab6-ccc2-52fe-a102-476781e38c0f with scrape type 2
2026-03-29 07:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7387eab6-ccc2-52fe-a102-476781e38c0f with scrape type 2
2026-03-29 07:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7387eab6-ccc2-52fe-a102-476781e38c0f, identifier: KL90594
2026-03-29 07:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-29 07:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594
2026-03-29 07:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7387eab6-ccc2-52fe-a102-476781e38c0f with identifier: KL90594 to the API
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:36:13Z',
'fuel_type': 'petrol',
'id': '7387eab6-ccc2-52fe-a102-476781e38c0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL90594',
'listing': 'auction',
'make': 'Daihatsu',
'model': 'Terios',
'odometer': 156915,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-15',
'seller_name': None,
'title': 'Daihatsu Terios 1.5 Top 4WD',
'transmission': 'manual',
'trim': 'Top 4WD',
'year': 2009}
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Saving data for KL90594: {'auction_closing_time': 1774884973.0, 'created_time': 1774550494.914282, 'last_price_update_time': 1774769541.488615}
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL90594') HTTP/1.1" 204 0
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-29 07:32:21 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Scrape type for DX01657: 2
2026-03-29 07:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-29 07:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88730801-e705-5c42-a028-601e950fcf63 with scrape type 2
2026-03-29 07:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88730801-e705-5c42-a028-601e950fcf63 with scrape type 2
2026-03-29 07:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88730801-e705-5c42-a028-601e950fcf63, identifier: DX01657
2026-03-29 07:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-29 07:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657
2026-03-29 07:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88730801-e705-5c42-a028-601e950fcf63 with identifier: DX01657 to the API
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:45:04Z',
'fuel_type': 'hybrid',
'id': '88730801-e705-5c42-a028-601e950fcf63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX01657',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris Touring Sports',
'odometer': 161770,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-14',
'seller_name': None,
'title': 'Toyota Auris Touring Sports 1.8 Hybrid Life+',
'transmission': 'automatic',
'trim': 'Life+',
'year': 2013}
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-29 07:32:21 [auto1.de] INFO: Saving data for DX01657: {'auction_closing_time': 1774885504.0, 'created_time': 1773916814.054608, 'last_price_update_time': 1774769541.976151}
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX01657') HTTP/1.1" 204 0
2026-03-29 07:32:22 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-29 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-29 07:32:22 [auto1.de] INFO: Scrape type for CP43977: 0
2026-03-29 07:32:22 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-29 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-29 07:32:22 [auto1.de] INFO: Scrape type for DT77440: 0
2026-03-29 07:32:22 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-29 07:32:22 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-29 07:32:22 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-29 07:32:22 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-29 07:32:22 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-29 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-29 07:32:22 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-29 07:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:23 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 6259 | hits on page: 40
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-29 07:32:23 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-29 07:32:23 [auto1.de] INFO: Scrape type for KM87247: 0
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-29 07:32:23 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-29 07:32:23 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-29 07:32:23 [auto1.de] INFO: Scrape type for KR04535: 0
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-29 07:32:23 [auto1.de] INFO: Scrape type for YN10477: 0
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-29 07:32:23 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-29 07:32:23 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-29 07:32:23 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-29 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for KV78740: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for WP28886: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for AB87355: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for ZD28576: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for BA95413: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for FB31140: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for XL62342: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for WV94095: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for MZ72792: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for HB06049: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for PD00543: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for BJ60837: 0
2026-03-29 07:32:24 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-29 07:32:24 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-29 07:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:25 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 6260 | hits on page: 40
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-29 07:32:25 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-29 07:32:25 [auto1.de] INFO: Scrape type for DU27539: 0
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-29 07:32:25 [auto1.de] INFO: Scrape type for LJ93781: 0
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-29 07:32:25 [auto1.de] INFO: Scrape type for RN03307: 0
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-29 07:32:25 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-29 07:32:25 [auto1.de] INFO: Scrape type for NN66597: 0
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-29 07:32:25 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-29 07:32:25 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-29 07:32:25 [auto1.de] INFO: Scrape type for JR17780: 2
2026-03-29 07:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-29 07:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with scrape type 2
2026-03-29 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with scrape type 2
2026-03-29 07:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc, identifier: JR17780
2026-03-29 07:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-29 07:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780
2026-03-29 07:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68c9a3cd-3f7d-5323-94bf-c8e96811cdbc with identifier: JR17780 to the API
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:36:05Z',
'fuel_type': 'petrol',
'id': '68c9a3cd-3f7d-5323-94bf-c8e96811cdbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR17780',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 129260,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-11',
'seller_name': None,
'title': 'BMW 3er 320Ci',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Saving data for JR17780: {'auction_closing_time': 1774884965.0, 'created_time': 1774552907.746601, 'last_price_update_time': 1774769546.399054}
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR17780') HTTP/1.1" 204 0
2026-03-29 07:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for WY54008: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for GV91046: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for ED00109: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for RZ48384: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for SB60272: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for TN32015: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-29 07:32:26 [auto1.de] INFO: Scrape type for XY68410: 0
2026-03-29 07:32:26 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-29 07:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:27 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 6260 | hits on page: 40
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for DA23811: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for DZ79939: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for TD17986: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for AS21942: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for XS38036: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for RV99753: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for MB94614: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for DT00101: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for HS55483: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-29 07:32:27 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-29 07:32:27 [auto1.de] INFO: Scrape type for BR02307: 2
2026-03-29 07:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-29 07:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fc1597-97d9-5093-981f-75f1459966f8 with scrape type 2
2026-03-29 07:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9fc1597-97d9-5093-981f-75f1459966f8 with scrape type 2
2026-03-29 07:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9fc1597-97d9-5093-981f-75f1459966f8, identifier: BR02307
2026-03-29 07:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-29 07:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307
2026-03-29 07:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9fc1597-97d9-5093-981f-75f1459966f8 with identifier: BR02307 to the API
2026-03-29 07:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:34:47Z',
'fuel_type': 'petrol',
'id': 'c9fc1597-97d9-5093-981f-75f1459966f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR02307',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 168486,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-02-21',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Saving data for BR02307: {'auction_closing_time': 1774884887.0, 'created_time': 1774551478.276678, 'last_price_update_time': 1774769549.235596}
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR02307') HTTP/1.1" 204 0
2026-03-29 07:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Scrape type for DF30572: 0
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Scrape type for PJ17742: 0
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Scrape type for FK97856: 0
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-29 07:32:29 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-29 07:32:29 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-29 07:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:30 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 6263 | hits on page: 40
2026-03-29 07:32:30 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-29 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-29 07:32:30 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-29 07:32:30 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-29 07:32:30 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-29 07:32:30 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-29 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-29 07:32:30 [auto1.de] INFO: Scrape type for DF02739: 0
2026-03-29 07:32:30 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-29 07:32:30 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-29 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-29 07:32:30 [auto1.de] INFO: Scrape type for CL06528: 2
2026-03-29 07:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-29 07:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with scrape type 2
2026-03-29 07:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with scrape type 2
2026-03-29 07:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 261adc2e-1e99-5a6c-8d56-f9d4e5203628, identifier: CL06528
2026-03-29 07:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-29 07:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528
2026-03-29 07:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 261adc2e-1e99-5a6c-8d56-f9d4e5203628 with identifier: CL06528 to the API
2026-03-29 07:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:46:42Z',
'fuel_type': 'petrol',
'id': '261adc2e-1e99-5a6c-8d56-f9d4e5203628',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL06528',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 49971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-08',
'seller_name': None,
'title': 'Hyundai i10 1.0 Passion',
'transmission': 'manual',
'trim': 'Passion',
'year': 2019}
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-29 07:32:31 [auto1.de] INFO: Saving data for CL06528: {'auction_closing_time': 1774885602.0, 'created_time': 1773945708.047113, 'last_price_update_time': 1774769551.366805}
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL06528') HTTP/1.1" 204 0
2026-03-29 07:32:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-29 07:32:31 [auto1.de] INFO: Scrape type for VK94352: 0
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-29 07:32:31 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-29 07:32:31 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-29 07:32:31 [auto1.de] INFO: Scrape type for UC38867: 2
2026-03-29 07:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-29 07:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bd1214-59f8-57e2-a2df-20914b0eb727 with scrape type 2
2026-03-29 07:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0bd1214-59f8-57e2-a2df-20914b0eb727 with scrape type 2
2026-03-29 07:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0bd1214-59f8-57e2-a2df-20914b0eb727, identifier: UC38867
2026-03-29 07:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-29 07:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867
2026-03-29 07:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0bd1214-59f8-57e2-a2df-20914b0eb727 with identifier: UC38867 to the API
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:17:07Z',
'fuel_type': 'petrol',
'id': 'f0bd1214-59f8-57e2-a2df-20914b0eb727',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC38867',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 30640,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-26',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2017}
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Saving data for UC38867: {'auction_closing_time': 1774883827.0, 'created_time': 1774552144.218025, 'last_price_update_time': 1774769552.103382}
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC38867') HTTP/1.1" 204 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for HH61225: 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for NR64586: 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for GC11605: 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for FM53272: 2
2026-03-29 07:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-29 07:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with scrape type 2
2026-03-29 07:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with scrape type 2
2026-03-29 07:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec, identifier: FM53272
2026-03-29 07:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-29 07:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272
2026-03-29 07:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec with identifier: FM53272 to the API
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:51:48Z',
'fuel_type': 'petrol',
'id': '2b3deb1f-e0a1-55c4-b8df-8a8eae98cdec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM53272',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 136115,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-29',
'seller_name': None,
'title': 'Seat Ateca 1.4 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Saving data for FM53272: {'auction_closing_time': 1774885908.0, 'created_time': 1774553014.077737, 'last_price_update_time': 1774769552.652592}
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM53272') HTTP/1.1" 204 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for UL70410: 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-29 07:32:32 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-29 07:32:32 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-29 07:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:33 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 6266 | hits on page: 40
2026-03-29 07:32:33 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-29 07:32:33 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-29 07:32:33 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-29 07:32:33 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-29 07:32:33 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-29 07:32:33 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-29 07:32:33 [auto1.de] INFO: Scrape type for EB33579: 0
2026-03-29 07:32:33 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-29 07:32:33 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-29 07:32:33 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-29 07:32:33 [auto1.de] INFO: Scrape type for UZ81937: 0
2026-03-29 07:32:33 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-29 07:32:33 [auto1.de] INFO: Scrape type for AZ05535: 2
2026-03-29 07:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-29 07:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a20cfbd8-21a1-517b-8f4c-760298d93660 with scrape type 2
2026-03-29 07:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a20cfbd8-21a1-517b-8f4c-760298d93660 with scrape type 2
2026-03-29 07:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a20cfbd8-21a1-517b-8f4c-760298d93660, identifier: AZ05535
2026-03-29 07:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-29 07:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535
2026-03-29 07:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a20cfbd8-21a1-517b-8f4c-760298d93660 with identifier: AZ05535 to the API
2026-03-29 07:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 455,
'expiration_date': '2026-03-30T15:10:26Z',
'fuel_type': 'petrol',
'id': 'a20cfbd8-21a1-517b-8f4c-760298d93660',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ05535',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 95046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-19',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 500 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2017}
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Saving data for AZ05535: {'auction_closing_time': 1774883426.0, 'created_time': 1774551038.547434, 'last_price_update_time': 1774769555.215878}
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ05535') HTTP/1.1" 204 0
2026-03-29 07:32:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for DW36097: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for MC22222: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for UB34830: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for FH94786: 2
2026-03-29 07:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-29 07:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31706614-c4a9-57f0-8950-068b251b4247 with scrape type 2
2026-03-29 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31706614-c4a9-57f0-8950-068b251b4247 with scrape type 2
2026-03-29 07:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31706614-c4a9-57f0-8950-068b251b4247, identifier: FH94786
2026-03-29 07:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-29 07:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786
2026-03-29 07:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31706614-c4a9-57f0-8950-068b251b4247 with identifier: FH94786 to the API
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:30:58Z',
'fuel_type': 'diesel',
'id': '31706614-c4a9-57f0-8950-068b251b4247',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH94786',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 88716,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-04',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2015}
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Saving data for FH94786: {'auction_closing_time': 1774884658.0, 'created_time': 1773945700.262138, 'last_price_update_time': 1774769555.801006}
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH94786') HTTP/1.1" 204 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for KX26949: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for RN18911: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for VW82123: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-29 07:32:35 [auto1.de] INFO: Scrape type for JJ95706: 0
2026-03-29 07:32:35 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-29 07:32:36 [auto1.de] INFO: Scrape type for DD89889: 0
2026-03-29 07:32:36 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-29 07:32:36 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-29 07:32:36 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-29 07:32:36 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-29 07:32:36 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-29 07:32:36 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-29 07:32:36 [auto1.de] INFO: Scrape type for UA36533: 0
2026-03-29 07:32:36 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-29 07:32:36 [auto1.de] INFO: Scrape type for AX51342: 0
2026-03-29 07:32:36 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-29 07:32:36 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-29 07:32:36 [auto1.de] INFO: Scrape type for YJ71992: 0
2026-03-29 07:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:37 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 6266 | hits on page: 40
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for XN70423: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for FG50189: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for ZA19141: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-29 07:32:37 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Scrape type for WJ04835: 2
2026-03-29 07:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-29 07:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with scrape type 2
2026-03-29 07:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with scrape type 2
2026-03-29 07:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e53c585-b8c2-588f-a3f7-daeb8cda5687, identifier: WJ04835
2026-03-29 07:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-29 07:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835
2026-03-29 07:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e53c585-b8c2-588f-a3f7-daeb8cda5687 with identifier: WJ04835 to the API
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:53:28Z',
'fuel_type': 'petrol',
'id': '2e53c585-b8c2-588f-a3f7-daeb8cda5687',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ04835',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 79386,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-13',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2017}
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-29 07:32:37 [auto1.de] INFO: Saving data for WJ04835: {'auction_closing_time': 1774886008.0, 'created_time': 1774552975.791394, 'last_price_update_time': 1774769557.977413}
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ04835') HTTP/1.1" 204 0
2026-03-29 07:32:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for MA41049: 2
2026-03-29 07:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-29 07:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6f7744-257d-5670-8a10-caf34f145406 with scrape type 2
2026-03-29 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6f7744-257d-5670-8a10-caf34f145406 with scrape type 2
2026-03-29 07:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f6f7744-257d-5670-8a10-caf34f145406, identifier: MA41049
2026-03-29 07:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-29 07:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049
2026-03-29 07:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f6f7744-257d-5670-8a10-caf34f145406 with identifier: MA41049 to the API
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:00:39Z',
'fuel_type': 'diesel',
'id': '0f6f7744-257d-5670-8a10-caf34f145406',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA41049',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 109518,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-06',
'seller_name': None,
'title': 'Audi A1 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Saving data for MA41049: {'auction_closing_time': 1774882839.0, 'created_time': 1774552850.297774, 'last_price_update_time': 1774769558.553606}
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA41049') HTTP/1.1" 204 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for AV25336: 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for ER78775: 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-29 07:32:38 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-29 07:32:38 [auto1.de] INFO: Scrape type for LT09542: 2
2026-03-29 07:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-29 07:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with scrape type 2
2026-03-29 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with scrape type 2
2026-03-29 07:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1, identifier: LT09542
2026-03-29 07:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-29 07:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542
2026-03-29 07:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1 with identifier: LT09542 to the API
2026-03-29 07:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:49Z',
'fuel_type': 'diesel',
'id': 'eade4b72-d26a-5b0b-8ceb-c2a0a603e8e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT09542',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'L 200',
'odometer': 66378,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-24',
'seller_name': None,
'title': 'Mitsubishi L 200 2.2 DI-D Intro Edition Doppelkabine 4WD',
'transmission': 'manual',
'trim': 'Intro Edition Doppelkabine 4WD',
'year': 2021}
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-29 07:32:39 [auto1.de] INFO: Saving data for LT09542: {'auction_closing_time': 1774884049.0, 'created_time': 1774552104.025224, 'last_price_update_time': 1774769559.473562}
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT09542') HTTP/1.1" 204 0
2026-03-29 07:32:39 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-29 07:32:39 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-29 07:32:39 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-29 07:32:39 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-29 07:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:40 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 6269 | hits on page: 40
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-29 07:32:40 [auto1.de] INFO: Scrape type for LT09542: 0
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-29 07:32:40 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-29 07:32:40 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-29 07:32:40 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-29 07:32:40 [auto1.de] INFO: Scrape type for VY61993: 0
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-29 07:32:40 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-29 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for MU33695: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for HJ54097: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for HA10430: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for RY91957: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for KG08192: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for TE32041: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for HX34455: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for HX00306: 0
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-29 07:32:41 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Scrape type for AR62221: 2
2026-03-29 07:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-29 07:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with scrape type 2
2026-03-29 07:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with scrape type 2
2026-03-29 07:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52880e4b-6cad-5a97-b17e-99a4cc2755c5, identifier: AR62221
2026-03-29 07:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-29 07:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221
2026-03-29 07:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52880e4b-6cad-5a97-b17e-99a4cc2755c5 with identifier: AR62221 to the API
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:26:47Z',
'fuel_type': 'petrol',
'id': '52880e4b-6cad-5a97-b17e-99a4cc2755c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR62221',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 174740,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-28',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-29 07:32:41 [auto1.de] INFO: Saving data for AR62221: {'auction_closing_time': 1774884407.0, 'created_time': 1774552431.811963, 'last_price_update_time': 1774769561.649456}
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR62221') HTTP/1.1" 204 0
2026-03-29 07:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:43 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 6271 | hits on page: 40
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-29 07:32:43 [auto1.de] INFO: Scrape type for AR62221: 0
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-29 07:32:43 [auto1.de] INFO: Scrape type for CY90259: 0
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-29 07:32:43 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-29 07:32:43 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-29 07:32:43 [auto1.de] INFO: Scrape type for BZ09697: 0
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-29 07:32:43 [auto1.de] INFO: Scrape type for GC82813: 0
2026-03-29 07:32:43 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-29 07:32:43 [auto1.de] INFO: Scrape type for PL23541: 2
2026-03-29 07:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-29 07:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with scrape type 2
2026-03-29 07:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with scrape type 2
2026-03-29 07:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd, identifier: PL23541
2026-03-29 07:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-29 07:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541
2026-03-29 07:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2aa0930a-4fd3-55bd-a021-cb148c9dfebd with identifier: PL23541 to the API
2026-03-29 07:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:10:26Z',
'fuel_type': 'petrol',
'id': '2aa0930a-4fd3-55bd-a021-cb148c9dfebd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL23541',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 236601,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-10',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2013}
2026-03-29 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-29 07:32:44 [auto1.de] INFO: Saving data for PL23541: {'auction_closing_time': 1774883426.0, 'created_time': 1774552679.213452, 'last_price_update_time': 1774769564.917309}
2026-03-29 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL23541') HTTP/1.1" 204 0
2026-03-29 07:32:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for ND33880: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for AB26225: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for SC70285: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for XB46016: 2
2026-03-29 07:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-29 07:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84f96fd-058d-50a7-910f-d3b395067d18 with scrape type 2
2026-03-29 07:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84f96fd-058d-50a7-910f-d3b395067d18 with scrape type 2
2026-03-29 07:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f84f96fd-058d-50a7-910f-d3b395067d18, identifier: XB46016
2026-03-29 07:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-29 07:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016
2026-03-29 07:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f84f96fd-058d-50a7-910f-d3b395067d18 with identifier: XB46016 to the API
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:53:14Z',
'fuel_type': 'diesel',
'id': 'f84f96fd-058d-50a7-910f-d3b395067d18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB46016',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 238510,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-11',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI 150 Jahre Opel',
'transmission': 'manual',
'trim': '150 Jahre',
'year': 2012}
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Saving data for XB46016: {'auction_closing_time': 1774885994.0, 'created_time': 1773916340.451143, 'last_price_update_time': 1774769565.710366}
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB46016') HTTP/1.1" 204 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for BX34768: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for FG09102: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for YF25460: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for KE90255: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for XK87583: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for KJ55573: 0
2026-03-29 07:32:45 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-29 07:32:45 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-29 07:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:46 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 6272 | hits on page: 40
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for YD46257: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for TA14554: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for PG30420: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-29 07:32:46 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-29 07:32:46 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-29 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-29 07:32:47 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-29 07:32:47 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-29 07:32:47 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-29 07:32:47 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-29 07:32:47 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-29 07:32:47 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-29 07:32:47 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-29 07:32:47 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-29 07:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:48 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 6275 | hits on page: 40
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for RH04581: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for XD11713: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for NW35011: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for GF78107: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-29 07:32:48 [auto1.de] INFO: Scrape type for CG74532: 0
2026-03-29 07:32:48 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for SM47095: 0
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for SD86365: 0
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for SZ48596: 0
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for YE46941: 0
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for WM09546: 0
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for GJ62462: 0
2026-03-29 07:32:49 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-29 07:32:49 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-29 07:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:50 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 6276 | hits on page: 40
2026-03-29 07:32:50 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-29 07:32:50 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-29 07:32:50 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-29 07:32:50 [auto1.de] INFO: Scrape type for DS71504: 0
2026-03-29 07:32:50 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-29 07:32:50 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-29 07:32:50 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-29 07:32:50 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-29 07:32:50 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-29 07:32:50 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-29 07:32:50 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-29 07:32:50 [auto1.de] INFO: Scrape type for WE79254: 2
2026-03-29 07:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-29 07:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ebb7c2-9354-5580-a69b-c618da39f6c0 with scrape type 2
2026-03-29 07:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ebb7c2-9354-5580-a69b-c618da39f6c0 with scrape type 2
2026-03-29 07:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39ebb7c2-9354-5580-a69b-c618da39f6c0, identifier: WE79254
2026-03-29 07:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-29 07:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254
2026-03-29 07:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39ebb7c2-9354-5580-a69b-c618da39f6c0 with identifier: WE79254 to the API
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:17:24Z',
'fuel_type': 'petrol',
'id': '39ebb7c2-9354-5580-a69b-c618da39f6c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE79254',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 171097,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-14',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2013}
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-29 07:32:51 [auto1.de] INFO: Saving data for WE79254: {'auction_closing_time': 1774883844.0, 'created_time': 1774552896.025092, 'last_price_update_time': 1774769571.431976}
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE79254') HTTP/1.1" 204 0
2026-03-29 07:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-29 07:32:51 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-29 07:32:51 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-29 07:32:51 [auto1.de] INFO: Scrape type for TY75534: 0
2026-03-29 07:32:51 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-29 07:32:51 [auto1.de] INFO: Scrape type for YT16808: 2
2026-03-29 07:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-29 07:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with scrape type 2
2026-03-29 07:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with scrape type 2
2026-03-29 07:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1, identifier: YT16808
2026-03-29 07:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-29 07:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808
2026-03-29 07:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c54da2d6-baf8-5f1d-a15b-3027cc45c2d1 with identifier: YT16808 to the API
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:58:11Z',
'fuel_type': 'diesel',
'id': 'c54da2d6-baf8-5f1d-a15b-3027cc45c2d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT16808',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 121361,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2015}
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Saving data for YT16808: {'auction_closing_time': 1774886291.0, 'created_time': 1774552583.184309, 'last_price_update_time': 1774769572.016856}
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT16808') HTTP/1.1" 204 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for AW88722: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for ZJ19484: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for AP34925: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for CD75324: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for ZY62714: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for HP95404: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-29 07:32:52 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-29 07:32:52 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-29 07:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:53 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 6279 | hits on page: 40
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for SR08314: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for BB98458: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for PY88123: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for ZV84359: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for DF95353: 2
2026-03-29 07:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-29 07:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b73d08a5-dd75-5f7c-9eca-e6714f372d56 with scrape type 2
2026-03-29 07:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b73d08a5-dd75-5f7c-9eca-e6714f372d56 with scrape type 2
2026-03-29 07:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b73d08a5-dd75-5f7c-9eca-e6714f372d56, identifier: DF95353
2026-03-29 07:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-29 07:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353
2026-03-29 07:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b73d08a5-dd75-5f7c-9eca-e6714f372d56 with identifier: DF95353 to the API
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:39:04Z',
'fuel_type': 'petrol',
'id': 'b73d08a5-dd75-5f7c-9eca-e6714f372d56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF95353',
'listing': 'auction',
'make': 'Kia',
'model': 'XCeed',
'odometer': 76657,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-24',
'seller_name': None,
'title': 'Kia XCeed 1.6 TGDI Black Xdition',
'transmission': 'automatic',
'trim': 'Black Xdition',
'year': 2021}
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Saving data for DF95353: {'auction_closing_time': 1774885144.0, 'created_time': 1774552505.025691, 'last_price_update_time': 1774769573.713361}
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF95353') HTTP/1.1" 204 0
2026-03-29 07:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for AB88110: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for PM23375: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-29 07:32:53 [auto1.de] INFO: Scrape type for HR10791: 0
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-29 07:32:53 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-29 07:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:55 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 6279 | hits on page: 40
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for BW77657: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for NK83819: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for ZZ59930: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for HH56316: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for LX86336: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for XF83287: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for YT57989: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for JS13151: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for NF38330: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Scrape type for BN76417: 2
2026-03-29 07:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-29 07:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb558e6-ec59-5f85-9dae-a97bfbeff81f with scrape type 2
2026-03-29 07:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbb558e6-ec59-5f85-9dae-a97bfbeff81f with scrape type 2
2026-03-29 07:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbb558e6-ec59-5f85-9dae-a97bfbeff81f, identifier: BN76417
2026-03-29 07:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-29 07:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417
2026-03-29 07:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbb558e6-ec59-5f85-9dae-a97bfbeff81f with identifier: BN76417 to the API
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:45:23Z',
'fuel_type': 'petrol',
'id': 'fbb558e6-ec59-5f85-9dae-a97bfbeff81f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN76417',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 175143,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-10',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2013}
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-29 07:32:55 [auto1.de] INFO: Saving data for BN76417: {'auction_closing_time': 1774885523.0, 'created_time': 1774552639.452933, 'last_price_update_time': 1774769575.880397}
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN76417') HTTP/1.1" 204 0
2026-03-29 07:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:55 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-29 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-29 07:32:56 [auto1.de] INFO: Scrape type for ZS47676: 0
2026-03-29 07:32:56 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-29 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-29 07:32:56 [auto1.de] INFO: Scrape type for CM15300: 0
2026-03-29 07:32:56 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-29 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-29 07:32:56 [auto1.de] INFO: Scrape type for EC93517: 0
2026-03-29 07:32:56 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-29 07:32:56 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-29 07:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:57 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 6280 | hits on page: 40
2026-03-29 07:32:57 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-29 07:32:57 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-29 07:32:57 [auto1.de] INFO: Scrape type for YN35790: 0
2026-03-29 07:32:57 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-29 07:32:57 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-29 07:32:57 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-29 07:32:57 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-29 07:32:57 [auto1.de] INFO: Scrape type for LT29180: 2
2026-03-29 07:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-29 07:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with scrape type 2
2026-03-29 07:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with scrape type 2
2026-03-29 07:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a, identifier: LT29180
2026-03-29 07:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-29 07:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180
2026-03-29 07:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40b4d1f6-4b6e-5b78-9f54-c6c8b553980a with identifier: LT29180 to the API
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:17:08Z',
'fuel_type': 'petrol',
'id': '40b4d1f6-4b6e-5b78-9f54-c6c8b553980a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT29180',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 263326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-09',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2009}
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-29 07:32:57 [auto1.de] INFO: Saving data for LT29180: {'auction_closing_time': 1774883828.0, 'created_time': 1774551841.295708, 'last_price_update_time': 1774769577.478014}
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT29180') HTTP/1.1" 204 0
2026-03-29 07:32:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:32:57 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-29 07:32:57 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-29 07:32:57 [auto1.de] INFO: Scrape type for AW08292: 2
2026-03-29 07:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-29 07:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with scrape type 2
2026-03-29 07:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with scrape type 2
2026-03-29 07:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074, identifier: AW08292
2026-03-29 07:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-29 07:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292
2026-03-29 07:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d56433f-ccf3-56e8-97fc-ee5a95ef3074 with identifier: AW08292 to the API
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:13:35Z',
'fuel_type': 'diesel',
'id': '3d56433f-ccf3-56e8-97fc-ee5a95ef3074',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW08292',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 244577,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-15',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Life 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Life 4Motion BlueMotion Tech',
'year': 2013}
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-29 07:32:57 [auto1.de] INFO: Saving data for AW08292: {'auction_closing_time': 1774883615.0, 'created_time': 1774589448.774175, 'last_price_update_time': 1774769577.926828}
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW08292') HTTP/1.1" 204 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for VC63070: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for TF71705: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for BT97147: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for WT86563: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for PS47170: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for AG08443: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for YJ47814: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Scrape type for KR99013: 2
2026-03-29 07:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-29 07:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94dc017-64c8-56df-95f3-24eb36c7e3f6 with scrape type 2
2026-03-29 07:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94dc017-64c8-56df-95f3-24eb36c7e3f6 with scrape type 2
2026-03-29 07:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b94dc017-64c8-56df-95f3-24eb36c7e3f6, identifier: KR99013
2026-03-29 07:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-29 07:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013
2026-03-29 07:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b94dc017-64c8-56df-95f3-24eb36c7e3f6 with identifier: KR99013 to the API
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:32Z',
'fuel_type': 'petrol',
'id': 'b94dc017-64c8-56df-95f3-24eb36c7e3f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR99013',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 100815,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-20',
'seller_name': None,
'title': 'Seat Ateca 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2022}
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-29 07:32:58 [auto1.de] INFO: Saving data for KR99013: {'auction_closing_time': 1774884872.0, 'created_time': 1774552737.954617, 'last_price_update_time': 1774769578.703919}
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR99013') HTTP/1.1" 204 0
2026-03-29 07:32:58 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-29 07:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:32:59 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 6282 | hits on page: 40
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for KR99013: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for VB93359: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for AL45510: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for AK65785: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for YH76604: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for EG34201: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for AW17852: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for AY57435: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-29 07:32:59 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-29 07:32:59 [auto1.de] INFO: Scrape type for BD44201: 0
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-29 07:33:00 [auto1.de] INFO: Scrape type for NG07529: 0
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-29 07:33:00 [auto1.de] INFO: Scrape type for LR76257: 0
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-29 07:33:00 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-29 07:33:00 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-29 07:33:00 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-29 07:33:00 [auto1.de] INFO: Scrape type for DC50657: 2
2026-03-29 07:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-29 07:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with scrape type 2
2026-03-29 07:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with scrape type 2
2026-03-29 07:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1, identifier: DC50657
2026-03-29 07:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-29 07:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657
2026-03-29 07:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1 with identifier: DC50657 to the API
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:59:02Z',
'fuel_type': 'petrol',
'id': 'fc0d859c-940d-55a9-9d1f-cd9b3a2b48e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC50657',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 94991,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-08',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-29 07:33:00 [auto1.de] INFO: Saving data for DC50657: {'auction_closing_time': 1774886342.0, 'created_time': 1774553087.557671, 'last_price_update_time': 1774769580.504885}
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC50657') HTTP/1.1" 204 0
2026-03-29 07:33:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:01 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 6284 | hits on page: 40
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for DC50657: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for UX10113: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for YF78558: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for MS73974: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for XE26333: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-29 07:33:01 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-29 07:33:01 [auto1.de] INFO: Scrape type for EL91395: 2
2026-03-29 07:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-29 07:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c25ffd9d-22a1-58fc-ac48-e6acaac22652 with scrape type 2
2026-03-29 07:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c25ffd9d-22a1-58fc-ac48-e6acaac22652 with scrape type 2
2026-03-29 07:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c25ffd9d-22a1-58fc-ac48-e6acaac22652, identifier: EL91395
2026-03-29 07:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-29 07:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395
2026-03-29 07:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c25ffd9d-22a1-58fc-ac48-e6acaac22652 with identifier: EL91395 to the API
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:01:07Z',
'fuel_type': 'petrol',
'id': 'c25ffd9d-22a1-58fc-ac48-e6acaac22652',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91395',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 101206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-12',
'seller_name': None,
'title': "Kia cee'd 1.6 GDI Spirit",
'transmission': 'automatic',
'trim': 'Spirit',
'year': 2016}
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Saving data for EL91395: {'auction_closing_time': 1774882867.0, 'created_time': 1774550835.454221, 'last_price_update_time': 1774769582.337637}
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL91395') HTTP/1.1" 204 0
2026-03-29 07:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Scrape type for KN65444: 0
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Scrape type for EB01944: 0
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Scrape type for NJ99986: 2
2026-03-29 07:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-29 07:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b88148ba-1898-5d41-99ee-1a21693766b2 with scrape type 2
2026-03-29 07:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b88148ba-1898-5d41-99ee-1a21693766b2 with scrape type 2
2026-03-29 07:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b88148ba-1898-5d41-99ee-1a21693766b2, identifier: NJ99986
2026-03-29 07:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-29 07:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986
2026-03-29 07:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b88148ba-1898-5d41-99ee-1a21693766b2 with identifier: NJ99986 to the API
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:39:23Z',
'fuel_type': 'petrol',
'id': 'b88148ba-1898-5d41-99ee-1a21693766b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ99986',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 43974,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-15',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2020}
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Saving data for NJ99986: {'auction_closing_time': 1774885163.0, 'created_time': 1774550451.941016, 'last_price_update_time': 1774769582.931955}
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ99986') HTTP/1.1" 204 0
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Scrape type for KM66171: 0
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Scrape type for TU73668: 0
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-29 07:33:02 [auto1.de] INFO: Scrape type for PT08625: 0
2026-03-29 07:33:02 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-29 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-29 07:33:03 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-29 07:33:03 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-29 07:33:03 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-29 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-29 07:33:03 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-29 07:33:03 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-29 07:33:03 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-29 07:33:06 [scrapy.extensions.logstats] INFO: Crawled 55 pages (at 21 pages/min), scraped 169 items (at 37 items/min)
2026-03-29 07:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 07:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:11 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 6287 | hits on page: 40
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for ZR39643: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for PJ34004: 2
2026-03-29 07:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-29 07:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with scrape type 2
2026-03-29 07:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with scrape type 2
2026-03-29 07:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9, identifier: PJ34004
2026-03-29 07:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-29 07:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004
2026-03-29 07:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9 with identifier: PJ34004 to the API
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:30:46Z',
'fuel_type': 'petrol',
'id': 'f0eb8fd0-a1d7-55e2-b5ea-52441de41fe9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ34004',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 27315,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-19',
'seller_name': None,
'title': 'Alfa Romeo Giulia 2.0 Turbo Ti Q4',
'transmission': 'automatic',
'trim': 'Ti Q4',
'year': 2024}
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Saving data for PJ34004: {'auction_closing_time': 1774884646.0, 'created_time': 1773945651.002095, 'last_price_update_time': 1774769591.547233}
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ34004') HTTP/1.1" 204 0
2026-03-29 07:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for JL65692: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for LK79875: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for AG47249: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for XB43693: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for HS53864: 0
2026-03-29 07:33:11 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-29 07:33:11 [auto1.de] INFO: Scrape type for EU79634: 2
2026-03-29 07:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-29 07:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 978faa5d-a950-51ce-af1a-d25f2c2e3856 with scrape type 2
2026-03-29 07:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 978faa5d-a950-51ce-af1a-d25f2c2e3856 with scrape type 2
2026-03-29 07:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 978faa5d-a950-51ce-af1a-d25f2c2e3856, identifier: EU79634
2026-03-29 07:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-29 07:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634
2026-03-29 07:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 978faa5d-a950-51ce-af1a-d25f2c2e3856 with identifier: EU79634 to the API
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:32:13Z',
'fuel_type': 'petrol',
'id': '978faa5d-a950-51ce-af1a-d25f2c2e3856',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU79634',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 229267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-06',
'seller_name': None,
'title': 'Skoda Roomster 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2009}
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-29 07:33:12 [auto1.de] INFO: Saving data for EU79634: {'auction_closing_time': 1774884733.0, 'created_time': 1774550403.534053, 'last_price_update_time': 1774769592.238622}
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU79634') HTTP/1.1" 204 0
2026-03-29 07:33:12 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-29 07:33:12 [auto1.de] INFO: Scrape type for RR35143: 0
2026-03-29 07:33:12 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-29 07:33:12 [auto1.de] INFO: Scrape type for XW28946: 0
2026-03-29 07:33:12 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-29 07:33:12 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-29 07:33:12 [auto1.de] INFO: Scrape type for KJ96980: 2
2026-03-29 07:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-29 07:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with scrape type 2
2026-03-29 07:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with scrape type 2
2026-03-29 07:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d, identifier: KJ96980
2026-03-29 07:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-29 07:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980
2026-03-29 07:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d with identifier: KJ96980 to the API
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:14:34Z',
'fuel_type': 'diesel',
'id': '275c3c0c-bf9c-5a9c-a7e7-3f4cfde0451d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ96980',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 176538,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-24',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2017}
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-29 07:33:12 [auto1.de] INFO: Saving data for KJ96980: {'auction_closing_time': 1774883674.0, 'created_time': 1774550869.884903, 'last_price_update_time': 1774769592.867678}
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ96980') HTTP/1.1" 204 0
2026-03-29 07:33:12 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-29 07:33:12 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-29 07:33:12 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-29 07:33:12 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-29 07:33:12 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-29 07:33:12 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-29 07:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:13 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 6288 | hits on page: 40
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-29 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-29 07:33:13 [auto1.de] INFO: Scrape type for GE03555: 0
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-29 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-29 07:33:13 [auto1.de] INFO: Scrape type for LM98964: 0
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-29 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-29 07:33:13 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-29 07:33:13 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-29 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-29 07:33:13 [auto1.de] INFO: Scrape type for BJ98180: 2
2026-03-29 07:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-29 07:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f938a2-302a-502b-8ae2-c5bd24720d71 with scrape type 2
2026-03-29 07:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67f938a2-302a-502b-8ae2-c5bd24720d71 with scrape type 2
2026-03-29 07:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67f938a2-302a-502b-8ae2-c5bd24720d71, identifier: BJ98180
2026-03-29 07:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-29 07:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180
2026-03-29 07:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67f938a2-302a-502b-8ae2-c5bd24720d71 with identifier: BJ98180 to the API
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:08Z',
'fuel_type': 'diesel',
'id': '67f938a2-302a-502b-8ae2-c5bd24720d71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ98180',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 313282,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-04',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
'transmission': 'automatic',
'trim': 'Scout 4x4',
'year': 2019}
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Saving data for BJ98180: {'auction_closing_time': 1774883108.0, 'created_time': 1773916500.862034, 'last_price_update_time': 1774769594.311942}
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ98180') HTTP/1.1" 204 0
2026-03-29 07:33:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Scrape type for PY37454: 0
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Scrape type for RZ53370: 2
2026-03-29 07:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-29 07:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af2b8648-900e-5999-addd-3e659c7d098c with scrape type 2
2026-03-29 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af2b8648-900e-5999-addd-3e659c7d098c with scrape type 2
2026-03-29 07:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af2b8648-900e-5999-addd-3e659c7d098c, identifier: RZ53370
2026-03-29 07:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-29 07:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370
2026-03-29 07:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af2b8648-900e-5999-addd-3e659c7d098c with identifier: RZ53370 to the API
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:03:54Z',
'fuel_type': 'petrol',
'id': 'af2b8648-900e-5999-addd-3e659c7d098c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ53370',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 102589,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-30',
'seller_name': None,
'title': 'BMW X3 xDrive 30i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Saving data for RZ53370: {'auction_closing_time': 1774883034.0, 'created_time': 1774553029.767081, 'last_price_update_time': 1774769594.872011}
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ53370') HTTP/1.1" 204 0
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Scrape type for PN22226: 0
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Scrape type for GU43225: 0
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-29 07:33:14 [auto1.de] INFO: Scrape type for JS31219: 0
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-29 07:33:14 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-29 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for WG78869: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for TF26076: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for NR99017: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for VG31593: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-29 07:33:15 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-29 07:33:15 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-29 07:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:32 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 6292 | hits on page: 40
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for ZT19745: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for KN67174: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for EX72807: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-29 07:33:32 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Scrape type for AH65179: 2
2026-03-29 07:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-29 07:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with scrape type 2
2026-03-29 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with scrape type 2
2026-03-29 07:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9, identifier: AH65179
2026-03-29 07:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-29 07:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179
2026-03-29 07:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9 with identifier: AH65179 to the API
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:20:37Z',
'fuel_type': 'diesel',
'id': '67d83b11-7eb4-5cf5-80ba-a7b0c2df46f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH65179',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 58734,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-10',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2019}
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-29 07:33:32 [auto1.de] INFO: Saving data for AH65179: {'auction_closing_time': 1774884037.0, 'created_time': 1774552745.370481, 'last_price_update_time': 1774769612.993209}
2026-03-29 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH65179') HTTP/1.1" 204 0
2026-03-29 07:33:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: US78573
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-29 07:33:33 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-29 07:33:33 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-29 07:33:33 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-29 07:33:33 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-29 07:33:33 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-29 07:33:33 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-29 07:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:34 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 6293 | hits on page: 40
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for NP24686: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for NR67134: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for AA40394: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for WD77905: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for XN62659: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-29 07:33:34 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-29 07:33:34 [auto1.de] INFO: Scrape type for HW81308: 2
2026-03-29 07:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-29 07:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with scrape type 2
2026-03-29 07:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with scrape type 2
2026-03-29 07:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2, identifier: HW81308
2026-03-29 07:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-29 07:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308
2026-03-29 07:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e0e4d35-ff94-585f-9cf7-db4ab8340fa2 with identifier: HW81308 to the API
2026-03-29 07:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:23:22Z',
'fuel_type': 'diesel',
'id': '2e0e4d35-ff94-585f-9cf7-db4ab8340fa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW81308',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 168377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-16',
'seller_name': None,
'title': 'BMW X1 xDrive 20d',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-29 07:33:35 [auto1.de] INFO: Saving data for HW81308: {'auction_closing_time': 1774884202.0, 'created_time': 1773945909.447446, 'last_price_update_time': 1774769615.833015}
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW81308') HTTP/1.1" 204 0
2026-03-29 07:33:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:35 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-29 07:33:35 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-29 07:33:35 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-29 07:33:35 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-29 07:33:35 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for RJ76690: 2
2026-03-29 07:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-29 07:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with scrape type 2
2026-03-29 07:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with scrape type 2
2026-03-29 07:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0, identifier: RJ76690
2026-03-29 07:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-29 07:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690
2026-03-29 07:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0 with identifier: RJ76690 to the API
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:01:13Z',
'fuel_type': 'petrol',
'id': '28f5dd3e-9e8f-51a9-ab94-1cba0a881bd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ76690',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 53943,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-22',
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2020}
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Saving data for RJ76690: {'auction_closing_time': 1774882873.0, 'created_time': 1774552305.477944, 'last_price_update_time': 1774769616.423817}
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ76690') HTTP/1.1" 204 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for AU22690: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for CC81369: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for RP88862: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for HJ55484: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for BK33721: 0
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-29 07:33:36 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-29 07:33:36 [auto1.de] INFO: Scrape type for ZT00838: 0
2026-03-29 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:37 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 6293 | hits on page: 40
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for GC03067: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for LW48006: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for VL45063: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for FX88340: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for DF33717: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for RJ96114: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-29 07:33:37 [auto1.de] INFO: Scrape type for MP68485: 0
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-29 07:33:37 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-29 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:38 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 6293 | hits on page: 40
2026-03-29 07:33:38 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-29 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-29 07:33:38 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-29 07:33:38 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-29 07:33:38 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-29 07:33:38 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-29 07:33:38 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-29 07:33:38 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-29 07:33:38 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-29 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-29 07:33:38 [auto1.de] INFO: Scrape type for BZ53185: 2
2026-03-29 07:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-29 07:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0166d2-96c1-5251-8dba-566ecfb302d7 with scrape type 2
2026-03-29 07:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0166d2-96c1-5251-8dba-566ecfb302d7 with scrape type 2
2026-03-29 07:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a0166d2-96c1-5251-8dba-566ecfb302d7, identifier: BZ53185
2026-03-29 07:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-29 07:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185
2026-03-29 07:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a0166d2-96c1-5251-8dba-566ecfb302d7 with identifier: BZ53185 to the API
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:06:30Z',
'fuel_type': 'petrol',
'id': '8a0166d2-96c1-5251-8dba-566ecfb302d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ53185',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 143387,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-24',
'seller_name': None,
'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
'transmission': 'manual',
'trim': 'Edition "111 Jahre"',
'year': 2010}
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-29 07:33:39 [auto1.de] INFO: Saving data for BZ53185: {'auction_closing_time': 1774883190.0, 'created_time': 1774552829.885699, 'last_price_update_time': 1774769619.255433}
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ53185') HTTP/1.1" 204 0
2026-03-29 07:33:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-29 07:33:39 [auto1.de] INFO: Scrape type for KR34750: 0
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-29 07:33:39 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: US02373
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-29 07:33:39 [auto1.de] INFO: Scrape type for US02373: 0
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-29 07:33:39 [auto1.de] INFO: Scrape type for WK90635: 0
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-29 07:33:39 [auto1.de] INFO: Scrape type for XY67074: 0
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-29 07:33:39 [auto1.de] INFO: Scrape type for ZW22458: 2
2026-03-29 07:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-29 07:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with scrape type 2
2026-03-29 07:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with scrape type 2
2026-03-29 07:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e574e2-962c-5b6f-b0f1-ce629fe943b7, identifier: ZW22458
2026-03-29 07:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-29 07:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458
2026-03-29 07:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e574e2-962c-5b6f-b0f1-ce629fe943b7 with identifier: ZW22458 to the API
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:30:58Z',
'fuel_type': 'petrol',
'id': '27e574e2-962c-5b6f-b0f1-ce629fe943b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW22458',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 106309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-12',
'seller_name': None,
'title': "Kia cee'd 1.4 Edition 7",
'transmission': 'manual',
'trim': 'Edition 7',
'year': 2018}
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-29 07:33:39 [auto1.de] INFO: Saving data for ZW22458: {'auction_closing_time': 1774884658.0, 'created_time': 1774550419.867046, 'last_price_update_time': 1774769619.88407}
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW22458') HTTP/1.1" 204 0
2026-03-29 07:33:39 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-29 07:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-29 07:33:40 [auto1.de] INFO: Scrape type for XT00440: 0
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-29 07:33:40 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-29 07:33:40 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-29 07:33:40 [auto1.de] INFO: Scrape type for DL51973: 0
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-29 07:33:40 [auto1.de] INFO: Scrape type for CG27437: 0
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-29 07:33:40 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-29 07:33:40 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-29 07:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:41 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 6293 | hits on page: 40
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for RM91715: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for VJ30367: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for BC27569: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for JT94626: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for MH82914: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for UZ08427: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for YG83893: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for WJ12441: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: US46384
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-29 07:33:41 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-29 07:33:41 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-29 07:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:42 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 6293 | hits on page: 40
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-29 07:33:42 [auto1.de] INFO: Scrape type for XB85584: 0
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-29 07:33:42 [auto1.de] INFO: Scrape type for RA04600: 0
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-29 07:33:42 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-29 07:33:42 [auto1.de] INFO: Scrape type for BN16879: 0
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-29 07:33:42 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-29 07:33:42 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-29 07:33:42 [auto1.de] INFO: Scrape type for WR53064: 2
2026-03-29 07:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-29 07:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb153bde-d42a-5581-83ea-3a0cd6c4c086 with scrape type 2
2026-03-29 07:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb153bde-d42a-5581-83ea-3a0cd6c4c086 with scrape type 2
2026-03-29 07:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb153bde-d42a-5581-83ea-3a0cd6c4c086, identifier: WR53064
2026-03-29 07:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-29 07:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064
2026-03-29 07:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb153bde-d42a-5581-83ea-3a0cd6c4c086 with identifier: WR53064 to the API
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:10:04Z',
'fuel_type': 'diesel',
'id': 'fb153bde-d42a-5581-83ea-3a0cd6c4c086',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR53064',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 162720,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Team BlueMotion',
'transmission': 'manual',
'trim': 'Team BlueMotion',
'year': 2011}
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Saving data for WR53064: {'auction_closing_time': 1774883404.0, 'created_time': 1774550635.424659, 'last_price_update_time': 1774769623.297159}
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR53064') HTTP/1.1" 204 0
2026-03-29 07:33:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Scrape type for YH66607: 0
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Scrape type for MC56654: 0
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Scrape type for BD12559: 0
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Scrape type for CY56514: 0
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-29 07:33:43 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Scrape type for UY95441: 2
2026-03-29 07:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-29 07:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with scrape type 2
2026-03-29 07:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with scrape type 2
2026-03-29 07:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2, identifier: UY95441
2026-03-29 07:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-29 07:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441
2026-03-29 07:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2 with identifier: UY95441 to the API
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:08:55Z',
'fuel_type': 'petrol',
'id': '3a30ed07-b84f-58ed-95b9-ca9d2d9ab6c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY95441',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 137738,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-12',
'seller_name': None,
'title': 'Toyota Corolla 1.6 Compact Sol',
'transmission': 'manual',
'trim': 'Compact Sol',
'year': 2005}
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-29 07:33:43 [auto1.de] INFO: Saving data for UY95441: {'auction_closing_time': 1774883335.0, 'created_time': 1773916862.210946, 'last_price_update_time': 1774769623.926067}
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY95441') HTTP/1.1" 204 0
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-29 07:33:44 [auto1.de] INFO: Scrape type for SC10304: 0
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-29 07:33:44 [auto1.de] INFO: Scrape type for HZ88582: 0
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-29 07:33:44 [auto1.de] INFO: Scrape type for XX83628: 0
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: US51436
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-29 07:33:44 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-29 07:33:44 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-29 07:33:44 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-29 07:33:44 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-29 07:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:45 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 6294 | hits on page: 40
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for EB22696: 2
2026-03-29 07:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-29 07:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d10e40-832c-54a6-8225-7b5773fad699 with scrape type 2
2026-03-29 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28d10e40-832c-54a6-8225-7b5773fad699 with scrape type 2
2026-03-29 07:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28d10e40-832c-54a6-8225-7b5773fad699, identifier: EB22696
2026-03-29 07:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-29 07:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696
2026-03-29 07:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28d10e40-832c-54a6-8225-7b5773fad699 with identifier: EB22696 to the API
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:40:44Z',
'fuel_type': 'petrol',
'id': '28d10e40-832c-54a6-8225-7b5773fad699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB22696',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 175697,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-20',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Saving data for EB22696: {'auction_closing_time': 1774885244.0, 'created_time': 1774550458.973322, 'last_price_update_time': 1774769625.737823}
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB22696') HTTP/1.1" 204 0
2026-03-29 07:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for NC35007: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for YT04304: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for SW44796: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for WP48150: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for XM92815: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for GE16975: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for KP27245: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-29 07:33:45 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-29 07:33:45 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for FJ40863: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for YM46431: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for EH98635: 2
2026-03-29 07:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-29 07:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a653b3-bfc7-5242-b232-61b7f69943ee with scrape type 2
2026-03-29 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a653b3-bfc7-5242-b232-61b7f69943ee with scrape type 2
2026-03-29 07:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a653b3-bfc7-5242-b232-61b7f69943ee, identifier: EH98635
2026-03-29 07:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-29 07:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635
2026-03-29 07:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a653b3-bfc7-5242-b232-61b7f69943ee with identifier: EH98635 to the API
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:41:39Z',
'fuel_type': 'diesel',
'id': 'b7a653b3-bfc7-5242-b232-61b7f69943ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH98635',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 247631,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-21',
'seller_name': None,
'title': 'Volvo XC60 2.4 D4 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2011}
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Saving data for EH98635: {'auction_closing_time': 1774885299.0, 'created_time': 1774552675.16393, 'last_price_update_time': 1774769626.574674}
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH98635') HTTP/1.1" 204 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-29 07:33:46 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-29 07:33:46 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-29 07:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:57 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 6299 | hits on page: 40
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for ZK30866: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for SA06109: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for VA96509: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for LV46830: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for HU76899: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-29 07:33:57 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-29 07:33:57 [auto1.de] INFO: Scrape type for XM85964: 2
2026-03-29 07:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-29 07:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with scrape type 2
2026-03-29 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with scrape type 2
2026-03-29 07:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313, identifier: XM85964
2026-03-29 07:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-29 07:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964
2026-03-29 07:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aa1c1e8-fc29-5b3a-8624-31a1592c0313 with identifier: XM85964 to the API
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:16:43Z',
'fuel_type': 'petrol',
'id': '5aa1c1e8-fc29-5b3a-8624-31a1592c0313',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM85964',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 142072,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-12',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2013}
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-29 07:33:58 [auto1.de] INFO: Saving data for XM85964: {'auction_closing_time': 1774883803.0, 'created_time': 1774550453.994882, 'last_price_update_time': 1774769638.254554}
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM85964') HTTP/1.1" 204 0
2026-03-29 07:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-29 07:33:58 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-29 07:33:58 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-29 07:33:58 [auto1.de] INFO: Scrape type for DW20402: 2
2026-03-29 07:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-29 07:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with scrape type 2
2026-03-29 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with scrape type 2
2026-03-29 07:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed, identifier: DW20402
2026-03-29 07:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-29 07:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402
2026-03-29 07:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed with identifier: DW20402 to the API
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:18:56Z',
'fuel_type': 'petrol',
'id': '47ec741c-f3b1-5a38-9afe-0b9d8dfb1eed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW20402',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 85484,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-07',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2010}
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-29 07:33:58 [auto1.de] INFO: Saving data for DW20402: {'auction_closing_time': 1774883936.0, 'created_time': 1774551198.614287, 'last_price_update_time': 1774769638.8093}
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW20402') HTTP/1.1" 204 0
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-29 07:33:58 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-29 07:33:58 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-29 07:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:33:59 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 6299 | hits on page: 40
2026-03-29 07:33:59 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-29 07:33:59 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-29 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-29 07:33:59 [auto1.de] INFO: Scrape type for RJ05854: 0
2026-03-29 07:33:59 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-29 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-29 07:33:59 [auto1.de] INFO: Scrape type for LZ09190: 0
2026-03-29 07:33:59 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-29 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-29 07:33:59 [auto1.de] INFO: Scrape type for AU06034: 2
2026-03-29 07:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-29 07:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ce9e7a-d909-5e79-836f-98ded9635476 with scrape type 2
2026-03-29 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0ce9e7a-d909-5e79-836f-98ded9635476 with scrape type 2
2026-03-29 07:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0ce9e7a-d909-5e79-836f-98ded9635476, identifier: AU06034
2026-03-29 07:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-29 07:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034
2026-03-29 07:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0ce9e7a-d909-5e79-836f-98ded9635476 with identifier: AU06034 to the API
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:10Z',
'fuel_type': 'diesel',
'id': 'e0ce9e7a-d909-5e79-836f-98ded9635476',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU06034',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 49012,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-17',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-29 07:34:00 [auto1.de] INFO: Saving data for AU06034: {'auction_closing_time': 1774884010.0, 'created_time': 1774550400.677971, 'last_price_update_time': 1774769640.425165}
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU06034') HTTP/1.1" 204 0
2026-03-29 07:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-29 07:34:00 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-29 07:34:00 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-29 07:34:00 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-29 07:34:00 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-29 07:34:00 [auto1.de] INFO: Scrape type for KG01306: 2
2026-03-29 07:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-29 07:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6614e19-e614-5e2b-920a-95a00d82c0f5 with scrape type 2
2026-03-29 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6614e19-e614-5e2b-920a-95a00d82c0f5 with scrape type 2
2026-03-29 07:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6614e19-e614-5e2b-920a-95a00d82c0f5, identifier: KG01306
2026-03-29 07:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-29 07:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306
2026-03-29 07:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6614e19-e614-5e2b-920a-95a00d82c0f5 with identifier: KG01306 to the API
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:20:10Z',
'fuel_type': 'diesel',
'id': 'a6614e19-e614-5e2b-920a-95a00d82c0f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG01306',
'listing': 'auction',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 99457,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seller_name': None,
'title': 'Nissan X-Trail 2.0 dCi Acenta 4x4',
'transmission': 'manual',
'trim': 'Acenta 4x4',
'year': 2017}
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Saving data for KG01306: {'auction_closing_time': 1774884010.0, 'created_time': 1774552928.753283, 'last_price_update_time': 1774769641.031365}
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG01306') HTTP/1.1" 204 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for GW76676: 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for NZ56847: 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for VS80969: 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for LS36397: 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for PF67152: 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU69669%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for YU69669: 0
2026-03-29 07:34:01 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-29 07:34:01 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-29 07:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:02 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 6301 | hits on page: 40
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU69669%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for YU69669: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for XR25495: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for MB36683: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for AK97582: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for CM72901: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for SC48990: 0
2026-03-29 07:34:02 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-29 07:34:02 [auto1.de] INFO: Scrape type for ZF45936: 2
2026-03-29 07:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-29 07:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with scrape type 2
2026-03-29 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with scrape type 2
2026-03-29 07:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e, identifier: ZF45936
2026-03-29 07:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-29 07:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936
2026-03-29 07:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d33e5ad-e765-5837-b46a-c3f52bd04b8e with identifier: ZF45936 to the API
2026-03-29 07:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:47Z',
'fuel_type': 'petrol',
'id': '9d33e5ad-e765-5837-b46a-c3f52bd04b8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF45936',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 73602,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-30',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
'transmission': 'automatic',
'trim': 'United',
'year': 2020}
2026-03-29 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-29 07:34:03 [auto1.de] INFO: Saving data for ZF45936: {'auction_closing_time': 1774883987.0, 'created_time': 1774550428.152798, 'last_price_update_time': 1774769643.865727}
2026-03-29 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF45936') HTTP/1.1" 204 0
2026-03-29 07:34:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:03 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-29 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-29 07:34:03 [auto1.de] INFO: Scrape type for EV39961: 0
2026-03-29 07:34:03 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-29 07:34:03 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-29 07:34:03 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-29 07:34:03 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-29 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-29 07:34:04 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-29 07:34:04 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-29 07:34:04 [auto1.de] INFO: Scrape type for GK14526: 2
2026-03-29 07:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-29 07:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b4209c-70c6-54ea-a56c-594112fb4f69 with scrape type 2
2026-03-29 07:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86b4209c-70c6-54ea-a56c-594112fb4f69 with scrape type 2
2026-03-29 07:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86b4209c-70c6-54ea-a56c-594112fb4f69, identifier: GK14526
2026-03-29 07:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-29 07:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526
2026-03-29 07:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86b4209c-70c6-54ea-a56c-594112fb4f69 with identifier: GK14526 to the API
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:40:16Z',
'fuel_type': 'diesel',
'id': '86b4209c-70c6-54ea-a56c-594112fb4f69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK14526',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 212247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-09',
'seller_name': None,
'title': 'Honda CR-V 2.2 DTEC Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2010}
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-29 07:34:04 [auto1.de] INFO: Saving data for GK14526: {'auction_closing_time': 1774885216.0, 'created_time': 1774552979.639552, 'last_price_update_time': 1774769644.423158}
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK14526') HTTP/1.1" 204 0
2026-03-29 07:34:04 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-29 07:34:04 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-29 07:34:04 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-29 07:34:04 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-29 07:34:04 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-29 07:34:04 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-29 07:34:04 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-29 07:34:04 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-29 07:34:04 [auto1.de] INFO: Scrape type for VY10701: 2
2026-03-29 07:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-29 07:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28341f4f-64c1-54f7-96fc-3050898b0c78 with scrape type 2
2026-03-29 07:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28341f4f-64c1-54f7-96fc-3050898b0c78 with scrape type 2
2026-03-29 07:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28341f4f-64c1-54f7-96fc-3050898b0c78, identifier: VY10701
2026-03-29 07:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-29 07:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701
2026-03-29 07:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28341f4f-64c1-54f7-96fc-3050898b0c78 with identifier: VY10701 to the API
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:41:15Z',
'fuel_type': 'diesel',
'id': '28341f4f-64c1-54f7-96fc-3050898b0c78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY10701',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 95881,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-27',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L4 Trend',
'transmission': 'manual',
'trim': '350 L4 Trend',
'year': 2023}
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-29 07:34:04 [auto1.de] INFO: Saving data for VY10701: {'auction_closing_time': 1774885275.0, 'created_time': 1774550721.033124, 'last_price_update_time': 1774769644.97907}
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY10701') HTTP/1.1" 204 0
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-29 07:34:05 [auto1.de] INFO: Scrape type for DJ74169: 0
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-29 07:34:05 [auto1.de] INFO: Scrape type for AF42457: 0
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-29 07:34:05 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-29 07:34:05 [auto1.de] INFO: Scrape type for AD28287: 0
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-29 07:34:05 [auto1.de] INFO: Scrape type for TN14580: 0
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-29 07:34:05 [auto1.de] INFO: Scrape type for FY25163: 0
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-29 07:34:05 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-29 07:34:05 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-29 07:34:05 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-29 07:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:06 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 6302 | hits on page: 40
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for SC26693: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for GB74339: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for AR53020: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for WY91699: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for HG94589: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for BB27376: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for XU64075: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for TL87064: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for AR55742: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for BK59777: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-29 07:34:06 [auto1.de] INFO: Scrape type for HF06660: 0
2026-03-29 07:34:06 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-29 07:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:06 [scrapy.extensions.logstats] INFO: Crawled 68 pages (at 13 pages/min), scraped 190 items (at 21 items/min)
2026-03-29 07:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 07:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:07 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 6302 | hits on page: 40
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-29 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-29 07:34:07 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-29 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-29 07:34:07 [auto1.de] INFO: Scrape type for CT00605: 0
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-29 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-29 07:34:07 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-29 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-29 07:34:07 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-29 07:34:07 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for PZ11168: 0
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for WE44185: 0
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for ZG00412: 0
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for UZ37067: 0
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for SL27608: 0
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for JA27410: 2
2026-03-29 07:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-29 07:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcabcd04-cbe2-541d-93d7-8eda73afcd0e with scrape type 2
2026-03-29 07:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcabcd04-cbe2-541d-93d7-8eda73afcd0e with scrape type 2
2026-03-29 07:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcabcd04-cbe2-541d-93d7-8eda73afcd0e, identifier: JA27410
2026-03-29 07:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-29 07:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410
2026-03-29 07:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcabcd04-cbe2-541d-93d7-8eda73afcd0e with identifier: JA27410 to the API
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:13:21Z',
'fuel_type': 'petrol',
'id': 'dcabcd04-cbe2-541d-93d7-8eda73afcd0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA27410',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 73032,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-27',
'seller_name': None,
'title': 'BMW 5er 540i',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Saving data for JA27410: {'auction_closing_time': 1774883601.0, 'created_time': 1774552958.941099, 'last_price_update_time': 1774769648.617421}
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA27410') HTTP/1.1" 204 0
2026-03-29 07:34:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for VR34423: 0
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-29 07:34:08 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-29 07:34:08 [auto1.de] INFO: Scrape type for UZ18000: 2
2026-03-29 07:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-29 07:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5fcae3b-e4de-54a3-b145-39c0cd683378 with scrape type 2
2026-03-29 07:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5fcae3b-e4de-54a3-b145-39c0cd683378 with scrape type 2
2026-03-29 07:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5fcae3b-e4de-54a3-b145-39c0cd683378, identifier: UZ18000
2026-03-29 07:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-29 07:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000
2026-03-29 07:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5fcae3b-e4de-54a3-b145-39c0cd683378 with identifier: UZ18000 to the API
2026-03-29 07:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:37:08Z',
'fuel_type': 'petrol',
'id': 'd5fcae3b-e4de-54a3-b145-39c0cd683378',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ18000',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 163026,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-29 07:34:09 [auto1.de] INFO: Saving data for UZ18000: {'auction_closing_time': 1774885028.0, 'created_time': 1774552707.478726, 'last_price_update_time': 1774769649.157244}
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ18000') HTTP/1.1" 204 0
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-29 07:34:09 [auto1.de] INFO: Scrape type for UK70882: 0
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-29 07:34:09 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-29 07:34:09 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-29 07:34:09 [auto1.de] INFO: Scrape type for SP10059: 2
2026-03-29 07:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-29 07:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with scrape type 2
2026-03-29 07:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with scrape type 2
2026-03-29 07:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a, identifier: SP10059
2026-03-29 07:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-29 07:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059
2026-03-29 07:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8227b11b-d940-5c87-9b9b-f6735ec5ef9a with identifier: SP10059 to the API
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:03Z',
'fuel_type': 'petrol',
'id': '8227b11b-d940-5c87-9b9b-f6735ec5ef9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP10059',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 140553,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-08',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2015}
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-29 07:34:09 [auto1.de] INFO: Saving data for SP10059: {'auction_closing_time': 1774882983.0, 'created_time': 1774550554.364328, 'last_price_update_time': 1774769649.639851}
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP10059') HTTP/1.1" 204 0
2026-03-29 07:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:10 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 6303 | hits on page: 40
2026-03-29 07:34:10 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-29 07:34:10 [auto1.de] INFO: Scrape type for SP10059: 0
2026-03-29 07:34:10 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-29 07:34:10 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-29 07:34:10 [auto1.de] INFO: Scrape type for VN46305: 0
2026-03-29 07:34:10 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-29 07:34:10 [auto1.de] INFO: Scrape type for TJ16115: 0
2026-03-29 07:34:10 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-29 07:34:10 [auto1.de] INFO: Scrape type for JK31212: 0
2026-03-29 07:34:10 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-29 07:34:10 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-29 07:34:10 [auto1.de] INFO: Scrape type for SM03586: 0
2026-03-29 07:34:10 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-29 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for XJ26035: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for GH26905: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for FE22716: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for YN77653: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for ZU59417: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for CS57817: 2
2026-03-29 07:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-29 07:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b023d71d-53b9-5e8f-a193-0eaa1d56b699 with scrape type 2
2026-03-29 07:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b023d71d-53b9-5e8f-a193-0eaa1d56b699 with scrape type 2
2026-03-29 07:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b023d71d-53b9-5e8f-a193-0eaa1d56b699, identifier: CS57817
2026-03-29 07:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-29 07:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817
2026-03-29 07:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b023d71d-53b9-5e8f-a193-0eaa1d56b699 with identifier: CS57817 to the API
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:39:46Z',
'fuel_type': 'petrol',
'id': 'b023d71d-53b9-5e8f-a193-0eaa1d56b699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS57817',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 158560,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-02',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2010}
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Saving data for CS57817: {'auction_closing_time': 1774885186.0, 'created_time': 1774550632.523109, 'last_price_update_time': 1774769651.601292}
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS57817') HTTP/1.1" 204 0
2026-03-29 07:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for DD95746: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for PN07086: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for RV27706: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-29 07:34:11 [auto1.de] INFO: Scrape type for ZK33939: 0
2026-03-29 07:34:11 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-29 07:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:13 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 6304 | hits on page: 40
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for SA17140: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for HE21190: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: US71241
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for US71241: 2
2026-03-29 07:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-29 07:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with scrape type 2
2026-03-29 07:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with scrape type 2
2026-03-29 07:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd, identifier: US71241
2026-03-29 07:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-29 07:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241
2026-03-29 07:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f50ef8-9aba-5924-bcc2-b05fb5cf08dd with identifier: US71241 to the API
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:20:20Z',
'fuel_type': 'petrol',
'id': '10f50ef8-9aba-5924-bcc2-b05fb5cf08dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US71241',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 182817,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-29',
'seller_name': None,
'title': 'Fiat Doblo 1.4 Turbo Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2013}
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Saving data for US71241: {'auction_closing_time': 1774884020.0, 'created_time': 1774552152.038279, 'last_price_update_time': 1774769653.620028}
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US71241') HTTP/1.1" 204 0
2026-03-29 07:34:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for YY49162: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for JR21224: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for DF59303: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for VW56389: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for JY33610: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for HM04457: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for EN90928: 0
2026-03-29 07:34:13 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-29 07:34:13 [auto1.de] INFO: Scrape type for KG29776: 2
2026-03-29 07:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-29 07:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d079a9b2-1b71-51ff-b51c-3deea7ea11cf with scrape type 2
2026-03-29 07:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d079a9b2-1b71-51ff-b51c-3deea7ea11cf with scrape type 2
2026-03-29 07:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d079a9b2-1b71-51ff-b51c-3deea7ea11cf, identifier: KG29776
2026-03-29 07:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-29 07:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776
2026-03-29 07:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d079a9b2-1b71-51ff-b51c-3deea7ea11cf with identifier: KG29776 to the API
2026-03-29 07:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:33:17Z',
'fuel_type': 'diesel',
'id': 'd079a9b2-1b71-51ff-b51c-3deea7ea11cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG29776',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 125633,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-09',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2011}
2026-03-29 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-29 07:34:14 [auto1.de] INFO: Saving data for KG29776: {'auction_closing_time': 1774884797.0, 'created_time': 1774552135.12405, 'last_price_update_time': 1774769654.310254}
2026-03-29 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG29776') HTTP/1.1" 204 0
2026-03-29 07:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:15 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 6305 | hits on page: 40
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for KG29776: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for CK79873: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for LH09734: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for XL73598: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for YA77478: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for BW33957: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for ZU42459: 0
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-29 07:34:15 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-29 07:34:15 [auto1.de] INFO: Scrape type for YD60070: 2
2026-03-29 07:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-29 07:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97d0e12-9ca1-581c-a761-e4df19eef248 with scrape type 2
2026-03-29 07:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d97d0e12-9ca1-581c-a761-e4df19eef248 with scrape type 2
2026-03-29 07:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d97d0e12-9ca1-581c-a761-e4df19eef248, identifier: YD60070
2026-03-29 07:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-29 07:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070
2026-03-29 07:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d97d0e12-9ca1-581c-a761-e4df19eef248 with identifier: YD60070 to the API
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:11:11Z',
'fuel_type': 'petrol',
'id': 'd97d0e12-9ca1-581c-a761-e4df19eef248',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD60070',
'listing': 'auction',
'make': 'BMW',
'model': 'Z4',
'odometer': 48763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-18',
'seller_name': None,
'title': 'BMW Z4 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-29 07:34:16 [auto1.de] INFO: Saving data for YD60070: {'auction_closing_time': 1774883471.0, 'created_time': 1774552186.469334, 'last_price_update_time': 1774769656.064878}
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD60070') HTTP/1.1" 204 0
2026-03-29 07:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:16 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-29 07:34:16 [auto1.de] INFO: Scrape type for CA27289: 2
2026-03-29 07:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-29 07:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743eaa40-a042-5c85-8147-f1fd9798a2ef with scrape type 2
2026-03-29 07:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743eaa40-a042-5c85-8147-f1fd9798a2ef with scrape type 2
2026-03-29 07:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 743eaa40-a042-5c85-8147-f1fd9798a2ef, identifier: CA27289
2026-03-29 07:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-29 07:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289
2026-03-29 07:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 743eaa40-a042-5c85-8147-f1fd9798a2ef with identifier: CA27289 to the API
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:26:22Z',
'fuel_type': 'petrol',
'id': '743eaa40-a042-5c85-8147-f1fd9798a2ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA27289',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 100623,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-02',
'seller_name': None,
'title': 'Hyundai i30 1.0 TGDI Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2018}
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-29 07:34:16 [auto1.de] INFO: Saving data for CA27289: {'auction_closing_time': 1774884382.0, 'created_time': 1774552109.659611, 'last_price_update_time': 1774769656.606507}
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA27289') HTTP/1.1" 204 0
2026-03-29 07:34:16 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-29 07:34:16 [auto1.de] INFO: Scrape type for ZF67159: 0
2026-03-29 07:34:16 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-29 07:34:16 [auto1.de] INFO: Scrape type for CW80278: 0
2026-03-29 07:34:16 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-29 07:34:16 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-29 07:34:16 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-29 07:34:16 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-29 07:34:16 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-29 07:34:16 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-29 07:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:17 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 6306 | hits on page: 40
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for LW43520: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for WR99181: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for XD58993: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for ME12043: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for SD97280: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for BP02747: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for BT37883: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for ST29936: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for FV26342: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for UV59464: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for GS49465: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for TU97792: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-29 07:34:17 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-29 07:34:17 [auto1.de] INFO: Scrape type for MA44978: 2
2026-03-29 07:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-29 07:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f785a168-36e5-57c6-9138-cf3c9e01bf69 with scrape type 2
2026-03-29 07:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f785a168-36e5-57c6-9138-cf3c9e01bf69 with scrape type 2
2026-03-29 07:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f785a168-36e5-57c6-9138-cf3c9e01bf69, identifier: MA44978
2026-03-29 07:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-29 07:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978
2026-03-29 07:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f785a168-36e5-57c6-9138-cf3c9e01bf69 with identifier: MA44978 to the API
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:13Z',
'fuel_type': 'diesel',
'id': 'f785a168-36e5-57c6-9138-cf3c9e01bf69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA44978',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 186405,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-23',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Center-Line',
'transmission': 'manual',
'trim': 'Center-Line',
'year': 2014}
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-29 07:34:18 [auto1.de] INFO: Saving data for MA44978: {'auction_closing_time': 1774884553.0, 'created_time': 1774550639.849563, 'last_price_update_time': 1774769658.33788}
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA44978') HTTP/1.1" 204 0
2026-03-29 07:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:18 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-29 07:34:18 [auto1.de] INFO: Scrape type for VG52113: 0
2026-03-29 07:34:18 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-29 07:34:18 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-29 07:34:18 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-29 07:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:19 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 6307 | hits on page: 40
2026-03-29 07:34:19 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-29 07:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-29 07:34:19 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-29 07:34:19 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-29 07:34:19 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-29 07:34:19 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-29 07:34:19 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-29 07:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-29 07:34:19 [auto1.de] INFO: Scrape type for CX62190: 2
2026-03-29 07:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-29 07:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with scrape type 2
2026-03-29 07:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with scrape type 2
2026-03-29 07:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d, identifier: CX62190
2026-03-29 07:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-29 07:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190
2026-03-29 07:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf8ae8c4-7d81-5714-9717-d9aaaae0d43d with identifier: CX62190 to the API
2026-03-29 07:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:11Z',
'fuel_type': 'diesel',
'id': 'bf8ae8c4-7d81-5714-9717-d9aaaae0d43d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX62190',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 123390,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-12',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2021}
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Saving data for CX62190: {'auction_closing_time': 1774884011.0, 'created_time': 1773917593.046965, 'last_price_update_time': 1774769660.146612}
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX62190') HTTP/1.1" 204 0
2026-03-29 07:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for RE06888: 2
2026-03-29 07:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-29 07:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d18c2ef2-1803-574c-94da-7ec485fa67d7 with scrape type 2
2026-03-29 07:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d18c2ef2-1803-574c-94da-7ec485fa67d7 with scrape type 2
2026-03-29 07:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d18c2ef2-1803-574c-94da-7ec485fa67d7, identifier: RE06888
2026-03-29 07:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-29 07:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888
2026-03-29 07:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d18c2ef2-1803-574c-94da-7ec485fa67d7 with identifier: RE06888 to the API
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:49Z',
'fuel_type': 'petrol',
'id': 'd18c2ef2-1803-574c-94da-7ec485fa67d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE06888',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 74009,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-28',
'seller_name': None,
'title': 'Audi Q3 35 TFSI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2019}
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Saving data for RE06888: {'auction_closing_time': 1774882849.0, 'created_time': 1774552734.545828, 'last_price_update_time': 1774769660.588582}
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE06888') HTTP/1.1" 204 0
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for HE92439: 0
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for MM36361: 0
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for SH26484: 0
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-29 07:34:20 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-29 07:34:20 [auto1.de] INFO: Scrape type for VH62706: 2
2026-03-29 07:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-29 07:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0daad80e-bf64-5947-9cef-59d26173ce6b with scrape type 2
2026-03-29 07:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0daad80e-bf64-5947-9cef-59d26173ce6b with scrape type 2
2026-03-29 07:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0daad80e-bf64-5947-9cef-59d26173ce6b, identifier: VH62706
2026-03-29 07:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-29 07:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706
2026-03-29 07:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0daad80e-bf64-5947-9cef-59d26173ce6b with identifier: VH62706 to the API
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:58:57Z',
'fuel_type': 'petrol',
'id': '0daad80e-bf64-5947-9cef-59d26173ce6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH62706',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 149001,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-29',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2017}
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Saving data for VH62706: {'auction_closing_time': 1774886337.0, 'created_time': 1774550684.020558, 'last_price_update_time': 1774769661.223261}
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH62706') HTTP/1.1" 204 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for NZ04570: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for BN48826: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for FC29722: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for EB96923: 2
2026-03-29 07:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-29 07:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2183a198-b484-514a-844d-ab161ab3696a with scrape type 2
2026-03-29 07:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2183a198-b484-514a-844d-ab161ab3696a with scrape type 2
2026-03-29 07:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2183a198-b484-514a-844d-ab161ab3696a, identifier: EB96923
2026-03-29 07:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-29 07:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923
2026-03-29 07:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2183a198-b484-514a-844d-ab161ab3696a with identifier: EB96923 to the API
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 199,
'expiration_date': '2026-03-30T15:54:51Z',
'fuel_type': 'diesel',
'id': '2183a198-b484-514a-844d-ab161ab3696a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB96923',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 113812,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Ocean',
'transmission': 'automatic',
'trim': 'Ocean',
'year': 2019}
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Saving data for EB96923: {'auction_closing_time': 1774886091.0, 'created_time': 1774552618.110459, 'last_price_update_time': 1774769661.820742}
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB96923') HTTP/1.1" 204 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for WL56832: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for MR61415: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for SA01659: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-29 07:34:21 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-29 07:34:21 [auto1.de] INFO: Scrape type for LK29782: 0
2026-03-29 07:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:22 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 6307 | hits on page: 40
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for HD39951: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for EV99140: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for EW54456: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for GM15631: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for EW11176: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for GK51404: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for PC09309: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for LG80642: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for MC04391: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-29 07:34:22 [auto1.de] INFO: Scrape type for KE01468: 0
2026-03-29 07:34:22 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-29 07:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-29 07:34:23 [auto1.de] INFO: Scrape type for PS82171: 0
2026-03-29 07:34:23 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-29 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-29 07:34:23 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-29 07:34:23 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-29 07:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:24 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 6307 | hits on page: 40
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for TK34912: 2
2026-03-29 07:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-29 07:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d178899-534f-531c-863c-87e000d95e7f with scrape type 2
2026-03-29 07:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d178899-534f-531c-863c-87e000d95e7f with scrape type 2
2026-03-29 07:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d178899-534f-531c-863c-87e000d95e7f, identifier: TK34912
2026-03-29 07:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-29 07:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912
2026-03-29 07:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d178899-534f-531c-863c-87e000d95e7f with identifier: TK34912 to the API
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:16:39Z',
'fuel_type': 'diesel',
'id': '4d178899-534f-531c-863c-87e000d95e7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK34912',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 118200,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-20',
'seller_name': None,
'title': 'Ford Transit 1.5 TDCi Kasten Trend',
'transmission': 'manual',
'trim': 'Kasten Trend',
'year': 2016}
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Saving data for TK34912: {'auction_closing_time': 1774883799.0, 'created_time': 1774552929.629483, 'last_price_update_time': 1774769664.718806}
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK34912') HTTP/1.1" 204 0
2026-03-29 07:34:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for EU22008: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for KF55313: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for UW00779: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for CE41516: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for PW82194: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for HT39177: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-29 07:34:24 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-29 07:34:24 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-29 07:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:25 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 6307 | hits on page: 40
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-29 07:34:25 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-29 07:34:25 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-29 07:34:25 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-29 07:34:25 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-29 07:34:25 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-29 07:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for FP35448: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for JU23189: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for PC18756: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for YT48598: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for FC76019: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for ET07412: 2
2026-03-29 07:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-29 07:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a070bd6-ea94-505e-870a-571a35627e97 with scrape type 2
2026-03-29 07:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a070bd6-ea94-505e-870a-571a35627e97 with scrape type 2
2026-03-29 07:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a070bd6-ea94-505e-870a-571a35627e97, identifier: ET07412
2026-03-29 07:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-29 07:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412
2026-03-29 07:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a070bd6-ea94-505e-870a-571a35627e97 with identifier: ET07412 to the API
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:14:51Z',
'fuel_type': 'petrol',
'id': '4a070bd6-ea94-505e-870a-571a35627e97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET07412',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 125817,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-12',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2017}
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Saving data for ET07412: {'auction_closing_time': 1774883691.0, 'created_time': 1774552568.559639, 'last_price_update_time': 1774769666.523772}
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET07412') HTTP/1.1" 204 0
2026-03-29 07:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for XC17243: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for BL84965: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for JC65588: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for ZH21180: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-29 07:34:26 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-29 07:34:26 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-29 07:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:31 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 6308 | hits on page: 40
2026-03-29 07:34:31 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-29 07:34:31 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-29 07:34:31 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-29 07:34:31 [auto1.de] INFO: Scrape type for MD20057: 0
2026-03-29 07:34:31 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-29 07:34:31 [auto1.de] INFO: Scrape type for EC25925: 0
2026-03-29 07:34:31 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-29 07:34:31 [auto1.de] INFO: Scrape type for FL94183: 0
2026-03-29 07:34:31 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-29 07:34:31 [auto1.de] INFO: Scrape type for DE69910: 0
2026-03-29 07:34:31 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-29 07:34:31 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-29 07:34:31 [auto1.de] INFO: Scrape type for EU24195: 2
2026-03-29 07:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-29 07:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with scrape type 2
2026-03-29 07:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with scrape type 2
2026-03-29 07:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce, identifier: EU24195
2026-03-29 07:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-29 07:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195
2026-03-29 07:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce with identifier: EU24195 to the API
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:04:04Z',
'fuel_type': 'diesel',
'id': '8badb1bf-9482-5bd0-8f8f-7fb1f616e9ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU24195',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 300756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-31',
'seller_name': None,
'title': 'Volvo XC60 2.4 D5 Summum AWD',
'transmission': 'automatic',
'trim': 'Summum AWD',
'year': 2010}
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-29 07:34:31 [auto1.de] INFO: Saving data for EU24195: {'auction_closing_time': 1774883044.0, 'created_time': 1774552550.675263, 'last_price_update_time': 1774769671.956875}
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU24195') HTTP/1.1" 204 0
2026-03-29 07:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for NT60185: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for RT01969: 2
2026-03-29 07:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-29 07:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b67095-709f-5552-a472-895acbcfb0f7 with scrape type 2
2026-03-29 07:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b67095-709f-5552-a472-895acbcfb0f7 with scrape type 2
2026-03-29 07:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21b67095-709f-5552-a472-895acbcfb0f7, identifier: RT01969
2026-03-29 07:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-29 07:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969
2026-03-29 07:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21b67095-709f-5552-a472-895acbcfb0f7 with identifier: RT01969 to the API
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:16:01Z',
'fuel_type': 'petrol',
'id': '21b67095-709f-5552-a472-895acbcfb0f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT01969',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 158610,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-25',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Saving data for RT01969: {'auction_closing_time': 1774883761.0, 'created_time': 1773945735.005559, 'last_price_update_time': 1774769672.5254}
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT01969') HTTP/1.1" 204 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for ZV29308: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for SX60280: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for DE42625: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for HF86895: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for SA50642: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for GM47642: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-29 07:34:32 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-29 07:34:32 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-29 07:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:33 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 6310 | hits on page: 40
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for ZU26768: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for YT53234: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for WS02654: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-29 07:34:33 [auto1.de] INFO: Scrape type for PF97511: 0
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-29 07:34:33 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-29 07:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-29 07:34:34 [auto1.de] INFO: Scrape type for DD70281: 0
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-29 07:34:34 [auto1.de] INFO: Scrape type for PE91450: 0
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-29 07:34:34 [auto1.de] INFO: Scrape type for VS10261: 2
2026-03-29 07:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-29 07:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be2c9a3-e875-5258-ae8c-68e48784f7ed with scrape type 2
2026-03-29 07:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be2c9a3-e875-5258-ae8c-68e48784f7ed with scrape type 2
2026-03-29 07:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9be2c9a3-e875-5258-ae8c-68e48784f7ed, identifier: VS10261
2026-03-29 07:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-29 07:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261
2026-03-29 07:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9be2c9a3-e875-5258-ae8c-68e48784f7ed with identifier: VS10261 to the API
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:32:30Z',
'fuel_type': 'petrol',
'id': '9be2c9a3-e875-5258-ae8c-68e48784f7ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS10261',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 27944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-26',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2019}
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-29 07:34:34 [auto1.de] INFO: Saving data for VS10261: {'auction_closing_time': 1774884750.0, 'created_time': 1774552847.417718, 'last_price_update_time': 1774769674.481328}
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS10261') HTTP/1.1" 204 0
2026-03-29 07:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-29 07:34:34 [auto1.de] INFO: Scrape type for NG44703: 0
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-29 07:34:34 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-29 07:34:34 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-29 07:34:34 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-29 07:34:34 [auto1.de] INFO: Scrape type for SZ55877: 0
2026-03-29 07:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:35 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 6310 | hits on page: 40
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-29 07:34:35 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-29 07:34:35 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-29 07:34:35 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-29 07:34:35 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-29 07:34:35 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-29 07:34:35 [auto1.de] INFO: Scrape type for AK43100: 2
2026-03-29 07:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-29 07:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2903661-63dd-5386-916d-5dac2dd0550f with scrape type 2
2026-03-29 07:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2903661-63dd-5386-916d-5dac2dd0550f with scrape type 2
2026-03-29 07:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2903661-63dd-5386-916d-5dac2dd0550f, identifier: AK43100
2026-03-29 07:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-29 07:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100
2026-03-29 07:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2903661-63dd-5386-916d-5dac2dd0550f with identifier: AK43100 to the API
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:12:03Z',
'fuel_type': 'petrol',
'id': 'c2903661-63dd-5386-916d-5dac2dd0550f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK43100',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 183209,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-30',
'seller_name': None,
'title': 'Peugeot 207 1.4 Urban Move',
'transmission': 'manual',
'trim': 'Urban Move',
'year': 2011}
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Saving data for AK43100: {'auction_closing_time': 1774883523.0, 'created_time': 1774552731.178961, 'last_price_update_time': 1774769676.322483}
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK43100') HTTP/1.1" 204 0
2026-03-29 07:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for SR59541: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for GJ71722: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for NY67891: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for SU06279: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for HW53715: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for HR44152: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-29 07:34:36 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-29 07:34:36 [auto1.de] INFO: Scrape type for AA30425: 2
2026-03-29 07:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-29 07:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23688e5d-ee29-5a73-87a8-f6f328163c0d with scrape type 2
2026-03-29 07:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23688e5d-ee29-5a73-87a8-f6f328163c0d with scrape type 2
2026-03-29 07:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23688e5d-ee29-5a73-87a8-f6f328163c0d, identifier: AA30425
2026-03-29 07:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-29 07:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425
2026-03-29 07:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23688e5d-ee29-5a73-87a8-f6f328163c0d with identifier: AA30425 to the API
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:05:45Z',
'fuel_type': 'petrol',
'id': '23688e5d-ee29-5a73-87a8-f6f328163c0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA30425',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 185160,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-08',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2012}
2026-03-29 07:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-29 07:34:37 [auto1.de] INFO: Saving data for AA30425: {'auction_closing_time': 1774883145.0, 'created_time': 1773917341.392454, 'last_price_update_time': 1774769677.014864}
2026-03-29 07:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA30425') HTTP/1.1" 204 0
2026-03-29 07:34:37 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-29 07:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-29 07:34:37 [auto1.de] INFO: Scrape type for AB14083: 0
2026-03-29 07:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:38 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 6310 | hits on page: 40
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for KT10840: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for JK17459: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for AK58988: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for ZN63350: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for TE39343: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for PP85770: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for AH71943: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for VY07286: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for MG63340: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for UE11202: 2
2026-03-29 07:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-29 07:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with scrape type 2
2026-03-29 07:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with scrape type 2
2026-03-29 07:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722, identifier: UE11202
2026-03-29 07:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-29 07:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202
2026-03-29 07:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6839f4b5-8145-5ebb-a1d2-b226fb3f6722 with identifier: UE11202 to the API
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:52:55Z',
'fuel_type': 'hybrid',
'id': '6839f4b5-8145-5ebb-a1d2-b226fb3f6722',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE11202',
'listing': 'auction',
'make': 'MG',
'model': '3',
'odometer': 11400,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-05-15',
'seller_name': None,
'title': 'MG 3 1.5 Hybrid+ Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2025}
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Saving data for UE11202: {'auction_closing_time': 1774885975.0, 'created_time': 1774552619.917788, 'last_price_update_time': 1774769678.7253}
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE11202') HTTP/1.1" 204 0
2026-03-29 07:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-29 07:34:38 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-29 07:34:38 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-29 07:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:40 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 6310 | hits on page: 40
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for HU16718: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for ZJ39351: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for HZ19691: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for RR18814: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for LC91411: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for NA53807: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for XU28434: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for KL26301: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for FF92976: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for BV74864: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-29 07:34:40 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-29 07:34:40 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-29 07:34:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:41 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 6313 | hits on page: 40
2026-03-29 07:34:41 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for BN30919: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for GS36326: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for TV33488: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for DF38507: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for FD55088: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for ZD02189: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for XX76692: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for SJ47682: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for JT24059: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for CW96119: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for AU29418: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for VH78915: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for AL51386: 0
2026-03-29 07:34:42 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-29 07:34:42 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-29 07:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:43 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 6314 | hits on page: 40
2026-03-29 07:34:43 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-29 07:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-29 07:34:43 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-29 07:34:43 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-29 07:34:43 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-29 07:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-29 07:34:43 [auto1.de] INFO: Scrape type for BR96483: 2
2026-03-29 07:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-29 07:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with scrape type 2
2026-03-29 07:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with scrape type 2
2026-03-29 07:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8, identifier: BR96483
2026-03-29 07:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-29 07:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483
2026-03-29 07:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8 with identifier: BR96483 to the API
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:44:36Z',
'fuel_type': 'diesel',
'id': 'e2daddf7-309e-5f06-ab32-4d3dcd9dfbc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR96483',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 266856,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-18',
'seller_name': None,
'title': 'Audi Q5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Saving data for BR96483: {'auction_closing_time': 1774885476.0, 'created_time': 1774552676.760561, 'last_price_update_time': 1774769684.296713}
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR96483') HTTP/1.1" 204 0
2026-03-29 07:34:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for JD98482: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for LL88784: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for VE44500: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for NR72053: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for HK68029: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for WP61796: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for VZ19342: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for KY92219: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for GH57189: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for AU27688: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for EN93789: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for HK20534: 0
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-29 07:34:44 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-29 07:34:44 [auto1.de] INFO: Scrape type for UA00536: 2
2026-03-29 07:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-29 07:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f77df8-94bc-50ac-a637-eff6158e3057 with scrape type 2
2026-03-29 07:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61f77df8-94bc-50ac-a637-eff6158e3057 with scrape type 2
2026-03-29 07:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61f77df8-94bc-50ac-a637-eff6158e3057, identifier: UA00536
2026-03-29 07:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-29 07:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536
2026-03-29 07:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61f77df8-94bc-50ac-a637-eff6158e3057 with identifier: UA00536 to the API
2026-03-29 07:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:43:42Z',
'fuel_type': 'petrol',
'id': '61f77df8-94bc-50ac-a637-eff6158e3057',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA00536',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 120819,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-28',
'seller_name': None,
'title': 'BMW X1 xDrive 20i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-29 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-29 07:34:45 [auto1.de] INFO: Saving data for UA00536: {'auction_closing_time': 1774885422.0, 'created_time': 1774552439.39108, 'last_price_update_time': 1774769685.164421}
2026-03-29 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA00536') HTTP/1.1" 204 0
2026-03-29 07:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:46 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 6315 | hits on page: 40
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for UA00536: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for BB78660: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for YA95886: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for TL72332: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for LC37503: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for AB73354: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for ZN20945: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for ZT78140: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for DW68578: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for WW16724: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for JT86021: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for MY70814: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for PJ38214: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for SE52893: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-29 07:34:46 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-29 07:34:46 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-29 07:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:47 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 6316 | hits on page: 40
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for CT44889: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for KL19137: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for WC63339: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for YJ03455: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for PZ40966: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for MV46012: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-29 07:34:47 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-29 07:34:47 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-29 07:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:48 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 6317 | hits on page: 40
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for WF56073: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for WF31302: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for GP68218: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-29 07:34:48 [auto1.de] INFO: Scrape type for TP00598: 0
2026-03-29 07:34:48 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-29 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for XB50161: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for NF34057: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for WY73016: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for EJ80862: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for ZV33449: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for GK43362: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-29 07:34:49 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-29 07:34:49 [auto1.de] INFO: Scrape type for ET35150: 0
2026-03-29 07:34:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:50 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 6317 | hits on page: 40
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-29 07:34:50 [auto1.de] INFO: Scrape type for WS02487: 0
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-29 07:34:50 [auto1.de] INFO: Scrape type for CW19006: 0
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-29 07:34:50 [auto1.de] INFO: Scrape type for NV33173: 0
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-29 07:34:50 [auto1.de] INFO: Scrape type for SA55190: 0
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-29 07:34:50 [auto1.de] INFO: Scrape type for PF96299: 0
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-29 07:34:50 [auto1.de] INFO: Scrape type for EZ94089: 0
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-29 07:34:50 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-29 07:34:50 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-29 07:34:50 [auto1.de] INFO: Scrape type for KU16473: 2
2026-03-29 07:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-29 07:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with scrape type 2
2026-03-29 07:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with scrape type 2
2026-03-29 07:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a, identifier: KU16473
2026-03-29 07:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-29 07:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473
2026-03-29 07:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 493b1b3d-62e6-5c80-a9df-1c1a45fd667a with identifier: KU16473 to the API
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:13:15Z',
'fuel_type': 'petrol',
'id': '493b1b3d-62e6-5c80-a9df-1c1a45fd667a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU16473',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 227149,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-10-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T Classic',
'transmission': 'automatic',
'trim': 'T Classic',
'year': 2005}
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-29 07:34:51 [auto1.de] INFO: Saving data for KU16473: {'auction_closing_time': 1774883595.0, 'created_time': 1774552710.887056, 'last_price_update_time': 1774769691.527226}
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU16473') HTTP/1.1" 204 0
2026-03-29 07:34:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-29 07:34:51 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-29 07:34:51 [auto1.de] INFO: Scrape type for JX40120: 0
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-29 07:34:51 [auto1.de] INFO: Scrape type for PL78300: 0
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-29 07:34:51 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-29 07:34:51 [auto1.de] INFO: Scrape type for ES44709: 0
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-29 07:34:51 [auto1.de] INFO: Scrape type for YE69852: 0
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-29 07:34:51 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-29 07:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:53 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 6317 | hits on page: 40
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for GM59339: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for PT90816: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for VS72441: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for ND35935: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for AM19734: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for MA76308: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for LX22574: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for DJ81890: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for AD30182: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for LV52918: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for PW08848: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-29 07:34:53 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-29 07:34:53 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-29 07:34:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:54 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 6319 | hits on page: 40
2026-03-29 07:34:54 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-29 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-29 07:34:54 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-29 07:34:54 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-29 07:34:54 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-29 07:34:54 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-29 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-29 07:34:54 [auto1.de] INFO: Scrape type for CK27476: 2
2026-03-29 07:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-29 07:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330338cb-3703-531e-bfe6-681a9cf1fdff with scrape type 2
2026-03-29 07:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 330338cb-3703-531e-bfe6-681a9cf1fdff with scrape type 2
2026-03-29 07:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 330338cb-3703-531e-bfe6-681a9cf1fdff, identifier: CK27476
2026-03-29 07:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-29 07:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476
2026-03-29 07:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 330338cb-3703-531e-bfe6-681a9cf1fdff with identifier: CK27476 to the API
2026-03-29 07:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:37:39Z',
'fuel_type': 'diesel',
'id': '330338cb-3703-531e-bfe6-681a9cf1fdff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK27476',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 140795,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-11',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2012}
2026-03-29 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-29 07:34:54 [auto1.de] INFO: Saving data for CK27476: {'auction_closing_time': 1774885059.0, 'created_time': 1774552967.285749, 'last_price_update_time': 1774769694.99257}
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK27476') HTTP/1.1" 204 0
2026-03-29 07:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for TY58494: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for UM48488: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for CD36674: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for EU37880: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-29 07:34:55 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-29 07:34:55 [auto1.de] INFO: Scrape type for MT90802: 2
2026-03-29 07:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-29 07:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e54dd4-b604-5ebe-ba17-f51f182b21dc with scrape type 2
2026-03-29 07:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e54dd4-b604-5ebe-ba17-f51f182b21dc with scrape type 2
2026-03-29 07:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83e54dd4-b604-5ebe-ba17-f51f182b21dc, identifier: MT90802
2026-03-29 07:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-29 07:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802
2026-03-29 07:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83e54dd4-b604-5ebe-ba17-f51f182b21dc with identifier: MT90802 to the API
2026-03-29 07:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:56:32Z',
'fuel_type': 'petrol',
'id': '83e54dd4-b604-5ebe-ba17-f51f182b21dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT90802',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 259410,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-17',
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2012}
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-29 07:34:56 [auto1.de] INFO: Saving data for MT90802: {'auction_closing_time': 1774886192.0, 'created_time': 1774552730.077489, 'last_price_update_time': 1774769696.147128}
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT90802') HTTP/1.1" 204 0
2026-03-29 07:34:56 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-29 07:34:56 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-29 07:34:56 [auto1.de] INFO: Scrape type for ZV40367: 0
2026-03-29 07:34:56 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-29 07:34:56 [auto1.de] INFO: Scrape type for XG94093: 0
2026-03-29 07:34:56 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-29 07:34:56 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-29 07:34:56 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-29 07:34:56 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-29 07:34:56 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-29 07:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:57 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 6322 | hits on page: 40
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for SY19126: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for CE31107: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for MM04684: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for HF47887: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for EN47046: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for ZU57618: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for PR50786: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for ZJ71499: 0
2026-03-29 07:34:57 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-29 07:34:57 [auto1.de] INFO: Scrape type for RG74932: 2
2026-03-29 07:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-29 07:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with scrape type 2
2026-03-29 07:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with scrape type 2
2026-03-29 07:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3be55d76-3f10-5cd1-93f4-0831693ac6b0, identifier: RG74932
2026-03-29 07:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-29 07:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932
2026-03-29 07:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3be55d76-3f10-5cd1-93f4-0831693ac6b0 with identifier: RG74932 to the API
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:33:56Z',
'fuel_type': 'petrol',
'id': '3be55d76-3f10-5cd1-93f4-0831693ac6b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG74932',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 232113,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-25',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2011}
2026-03-29 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-29 07:34:58 [auto1.de] INFO: Saving data for RG74932: {'auction_closing_time': 1774884836.0, 'created_time': 1774551877.545696, 'last_price_update_time': 1774769698.046069}
2026-03-29 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG74932') HTTP/1.1" 204 0
2026-03-29 07:34:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:34:58 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-29 07:34:58 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-29 07:34:58 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-29 07:34:58 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-29 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-29 07:34:58 [auto1.de] INFO: Scrape type for BX95848: 0
2026-03-29 07:34:58 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-29 07:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:34:59 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 6324 | hits on page: 40
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for BX95848: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for LX45168: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for UU73518: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for XM77164: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for HD14897: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for DZ93039: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for AG38936: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for CJ15757: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for ZX08266: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for XF58855: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-29 07:34:59 [auto1.de] INFO: Scrape type for PN31203: 0
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-29 07:34:59 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-29 07:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:00 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 6324 | hits on page: 40
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for YW88691: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for GL29302: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for BF85943: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for YH44518: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for LM46602: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for HA16942: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for EE67524: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for VY57936: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for AJ85569: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for CW59742: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for BW06132: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for TV11727: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-29 07:35:00 [auto1.de] INFO: Scrape type for FP32439: 0
2026-03-29 07:35:00 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-29 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-29 07:35:01 [auto1.de] INFO: Scrape type for KY67779: 0
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-29 07:35:01 [auto1.de] INFO: Scrape type for WJ94391: 0
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-29 07:35:01 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-29 07:35:01 [auto1.de] INFO: Scrape type for GR86063: 0
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-29 07:35:01 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-29 07:35:01 [auto1.de] INFO: Scrape type for UH78050: 0
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-29 07:35:01 [auto1.de] INFO: Scrape type for JL85877: 0
2026-03-29 07:35:01 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-29 07:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:02 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 6325 | hits on page: 40
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for DR31322: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for TJ09014: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for TA25367: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for AL26903: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for HL58412: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for SR77795: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for PN78353: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for SM91292: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for FZ71323: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for AH37368: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for EF84485: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-29 07:35:02 [auto1.de] INFO: Scrape type for EG77695: 0
2026-03-29 07:35:02 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-29 07:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:03 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 6325 | hits on page: 40
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for BA73417: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for DW23670: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for WA19353: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for UY13477: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for GM59511: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for ZL15649: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for BL86865: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for SR51449: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for EN73396: 0
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-29 07:35:03 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-29 07:35:03 [auto1.de] INFO: Scrape type for CB52035: 2
2026-03-29 07:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-29 07:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545d778-8fe6-53f9-b700-b5146a776dc7 with scrape type 2
2026-03-29 07:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c545d778-8fe6-53f9-b700-b5146a776dc7 with scrape type 2
2026-03-29 07:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c545d778-8fe6-53f9-b700-b5146a776dc7, identifier: CB52035
2026-03-29 07:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-29 07:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035
2026-03-29 07:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c545d778-8fe6-53f9-b700-b5146a776dc7 with identifier: CB52035 to the API
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:32:31Z',
'fuel_type': 'petrol',
'id': 'c545d778-8fe6-53f9-b700-b5146a776dc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB52035',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 123112,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-13',
'seller_name': None,
'title': 'Mazda 2 1.5 Exclusive-Line',
'transmission': 'manual',
'trim': 'Exclusive-Line',
'year': 2015}
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-29 07:35:04 [auto1.de] INFO: Saving data for CB52035: {'auction_closing_time': 1774884751.0, 'created_time': 1774552718.204607, 'last_price_update_time': 1774769704.50113}
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB52035') HTTP/1.1" 204 0
2026-03-29 07:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-29 07:35:04 [auto1.de] INFO: Scrape type for XD56030: 0
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-29 07:35:04 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-29 07:35:04 [auto1.de] INFO: Scrape type for CC89680: 0
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-29 07:35:04 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-29 07:35:04 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-29 07:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:05 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 6325 | hits on page: 40
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-29 07:35:05 [auto1.de] INFO: Scrape type for YF42870: 0
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-29 07:35:05 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-29 07:35:05 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-29 07:35:05 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-29 07:35:05 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-29 07:35:05 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-29 07:35:05 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-29 07:35:05 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-29 07:35:05 [auto1.de] INFO: Scrape type for DG24182: 2
2026-03-29 07:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-29 07:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 391363dd-df68-5ec1-8671-1bfa10354a9b with scrape type 2
2026-03-29 07:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 391363dd-df68-5ec1-8671-1bfa10354a9b with scrape type 2
2026-03-29 07:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 391363dd-df68-5ec1-8671-1bfa10354a9b, identifier: DG24182
2026-03-29 07:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-29 07:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182
2026-03-29 07:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 391363dd-df68-5ec1-8671-1bfa10354a9b with identifier: DG24182 to the API
2026-03-29 07:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:31:43Z',
'fuel_type': 'petrol',
'id': '391363dd-df68-5ec1-8671-1bfa10354a9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG24182',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 55281,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-21',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2021}
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Saving data for DG24182: {'auction_closing_time': 1774884703.0, 'created_time': 1774553000.517741, 'last_price_update_time': 1774769706.193319}
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG24182') HTTP/1.1" 204 0
2026-03-29 07:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for CV73879: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for WL17910: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for BS26605: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for JS09258: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for GD60404: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for TJ67594: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for VT43931: 0
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-29 07:35:06 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-29 07:35:06 [auto1.de] INFO: Scrape type for GV28684: 0
2026-03-29 07:35:06 [scrapy.extensions.logstats] INFO: Crawled 96 pages (at 28 pages/min), scraped 219 items (at 29 items/min)
2026-03-29 07:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 07:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:07 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 6325 | hits on page: 40
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for YS13064: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for VJ59637: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for VL16221: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for AH95980: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for PC60688: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-29 07:35:07 [auto1.de] INFO: Scrape type for XM62598: 0
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-29 07:35:07 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-29 07:35:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:08 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 6325 | hits on page: 40
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-29 07:35:08 [auto1.de] INFO: Scrape type for MG28857: 0
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-29 07:35:08 [auto1.de] INFO: Scrape type for LR06917: 0
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-29 07:35:08 [auto1.de] INFO: Scrape type for UE57150: 0
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-29 07:35:08 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-29 07:35:08 [auto1.de] INFO: Scrape type for JX01740: 0
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-29 07:35:08 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-29 07:35:09 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-29 07:35:09 [auto1.de] INFO: Scrape type for BD98070: 0
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-29 07:35:09 [auto1.de] INFO: Scrape type for PH00076: 0
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-29 07:35:09 [auto1.de] INFO: Scrape type for AD50420: 0
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-29 07:35:09 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-29 07:35:09 [auto1.de] INFO: Scrape type for LN93862: 0
2026-03-29 07:35:09 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-29 07:35:09 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-29 07:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:10 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 6326 | hits on page: 40
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for BR76788: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for ZL76152: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for PA85998: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for SE32009: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for VT76935: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for AP07103: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for BE16908: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for JH64089: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for GY26864: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for MX47183: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for ZM37202: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for CS78773: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for NY15812: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for UW48203: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-29 07:35:10 [auto1.de] INFO: Scrape type for EB92999: 0
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-29 07:35:10 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-29 07:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:12 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 6326 | hits on page: 40
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for EY23363: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for HV21869: 2
2026-03-29 07:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-29 07:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f212d7-cafe-5533-a353-89c6013d5fb6 with scrape type 2
2026-03-29 07:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2f212d7-cafe-5533-a353-89c6013d5fb6 with scrape type 2
2026-03-29 07:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2f212d7-cafe-5533-a353-89c6013d5fb6, identifier: HV21869
2026-03-29 07:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-29 07:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869
2026-03-29 07:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2f212d7-cafe-5533-a353-89c6013d5fb6 with identifier: HV21869 to the API
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:17:21Z',
'fuel_type': 'petrol',
'id': 'f2f212d7-cafe-5533-a353-89c6013d5fb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV21869',
'listing': 'auction',
'make': 'Honda',
'model': 'Jazz',
'odometer': 91979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-31',
'seller_name': None,
'title': 'Honda Jazz 1.2 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2009}
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Saving data for HV21869: {'auction_closing_time': 1774883841.0, 'created_time': 1774552721.987186, 'last_price_update_time': 1774769712.693162}
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV21869') HTTP/1.1" 204 0
2026-03-29 07:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for WK06356: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for LU56386: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for DU69800: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for AH07700: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for AF84640: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for WY87564: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for BW18754: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for GZ21000: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-29 07:35:12 [auto1.de] INFO: Scrape type for GP94559: 0
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-29 07:35:12 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-29 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-29 07:35:13 [auto1.de] INFO: Scrape type for YM28187: 0
2026-03-29 07:35:13 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-29 07:35:13 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-29 07:35:13 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-29 07:35:13 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-29 07:35:13 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-29 07:35:13 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-29 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-29 07:35:13 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-29 07:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:14 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 6330 | hits on page: 40
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for ZE75344: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for GA26329: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for FW15462: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for AH97983: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for NP64585: 2
2026-03-29 07:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-29 07:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with scrape type 2
2026-03-29 07:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with scrape type 2
2026-03-29 07:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 321b5b8f-6920-59cf-91f0-bb473f4d9d82, identifier: NP64585
2026-03-29 07:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-29 07:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585
2026-03-29 07:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 321b5b8f-6920-59cf-91f0-bb473f4d9d82 with identifier: NP64585 to the API
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:53:10Z',
'fuel_type': 'diesel',
'id': '321b5b8f-6920-59cf-91f0-bb473f4d9d82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP64585',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 115054,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-22',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC',
'transmission': 'manual',
'trim': 'BlueTEC',
'year': 2015}
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Saving data for NP64585: {'auction_closing_time': 1774885990.0, 'created_time': 1774550722.680514, 'last_price_update_time': 1774769714.640068}
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP64585') HTTP/1.1" 204 0
2026-03-29 07:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for EG01443: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for VT05460: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for BF09730: 0
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-29 07:35:14 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-29 07:35:14 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-29 07:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:15 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 6332 | hits on page: 40
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-29 07:35:15 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-29 07:35:15 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-29 07:35:15 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-29 07:35:15 [auto1.de] INFO: Scrape type for BV47016: 0
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-29 07:35:15 [auto1.de] INFO: Scrape type for ZY22077: 0
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-29 07:35:15 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-29 07:35:15 [auto1.de] INFO: Scrape type for YC50370: 0
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-29 07:35:15 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-29 07:35:15 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-29 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for MZ26894: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for XF59932: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for BS14183: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for BT69693: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for ZJ17739: 0
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-29 07:35:16 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-29 07:35:16 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-29 07:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:17 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 6332 | hits on page: 40
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for TF11415: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for DE35783: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for UX71045: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for WS30363: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for NS47503: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for HB69443: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for HU97464: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for SC05662: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-29 07:35:17 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-29 07:35:17 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-29 07:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:25 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 6333 | hits on page: 40
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for LF03511: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for RC37998: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for BV72825: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for RX78682: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for UP35116: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for SV37503: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for SV69696: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for BA36034: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for BX38798: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for DJ74321: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-29 07:35:25 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-29 07:35:25 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-29 07:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:28 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 6333 | hits on page: 40
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for PK18306: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for PK39186: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for RG82987: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for WH66881: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for ND02727: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for WJ18132: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for JR30174: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for YJ23133: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for SX51992: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for KT07926: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for MC50567: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for NY75190: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for SS68419: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for FP97739: 0
2026-03-29 07:35:28 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-29 07:35:28 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-29 07:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:29 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 6334 | hits on page: 40
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for KX42000: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for YH85992: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for KY48204: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for NR01003: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for TJ52471: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for LB47051: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for BB05749: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for AU38078: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for BV96040: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for FK93583: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for MF11383: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for CA11296: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-29 07:35:29 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-29 07:35:29 [auto1.de] INFO: Scrape type for HT64251: 0
2026-03-29 07:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:31 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 6334 | hits on page: 40
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for XE57640: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for HX44464: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for WD55568: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for GN84809: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: US02416
2026-03-29 07:35:31 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-29 07:35:31 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-29 07:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:32 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 6334 | hits on page: 40
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for SP71400: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for TB03124: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for ZN04335: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for SR63884: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for MR29539: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for ZA74558: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for UL19330: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for DH60406: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for LV98525: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-29 07:35:32 [auto1.de] INFO: Scrape type for FF90181: 0
2026-03-29 07:35:32 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for PS26933: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for KK20650: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for AJ08508: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for JW09174: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for XL45586: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for JF78286: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-29 07:35:33 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-29 07:35:33 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-29 07:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:34 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 6334 | hits on page: 40
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for NS04983: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for MM23773: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for FY22177: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for ZS84546: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for BD72910: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for NG76002: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for AJ71122: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for MV27472: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for GB27977: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for DM13382: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-29 07:35:34 [auto1.de] INFO: Scrape type for XR73410: 0
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-29 07:35:34 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for BG13835: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for KX79678: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for BJ03907: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for BE52525: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for ZD84444: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for AS79616: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for FD07804: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-29 07:35:35 [auto1.de] INFO: Scrape type for MK09620: 0
2026-03-29 07:35:35 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-29 07:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:36 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 6334 | hits on page: 40
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for TP67168: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for AL71232: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for YH93335: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for HA99169: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for GU28360: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for NY39865: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for BH40486: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for FC58368: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for EU55937: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for TL72428: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-29 07:35:36 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-29 07:35:36 [auto1.de] INFO: Scrape type for CT75216: 0
2026-03-29 07:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:37 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 6334 | hits on page: 40
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for CN22561: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for ZH54779: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for KV75239: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for WN20430: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for UE30876: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for EY98011: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for MK93259: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for NY21344: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for NS09930: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for HL07149: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for XR43208: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-29 07:35:37 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-29 07:35:37 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-29 07:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:46 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 6336 | hits on page: 40
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for KU93910: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for EC39473: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for ND18169: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for EE74949: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for AN93893: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for AP20693: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-29 07:35:46 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-29 07:35:46 [auto1.de] INFO: Scrape type for VX05177: 2
2026-03-29 07:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-29 07:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b3d7712-a374-5d9e-8caf-726c5516141c with scrape type 2
2026-03-29 07:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b3d7712-a374-5d9e-8caf-726c5516141c with scrape type 2
2026-03-29 07:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b3d7712-a374-5d9e-8caf-726c5516141c, identifier: VX05177
2026-03-29 07:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-29 07:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177
2026-03-29 07:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b3d7712-a374-5d9e-8caf-726c5516141c with identifier: VX05177 to the API
2026-03-29 07:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:59:40Z',
'fuel_type': 'petrol',
'id': '3b3d7712-a374-5d9e-8caf-726c5516141c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX05177',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 27849,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-14',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2026-03-29 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-29 07:35:47 [auto1.de] INFO: Saving data for VX05177: {'auction_closing_time': 1774886380.0, 'created_time': 1773946027.48638, 'last_price_update_time': 1774769747.489616}
2026-03-29 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX05177') HTTP/1.1" 204 0
2026-03-29 07:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:47 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-29 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-29 07:35:47 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-29 07:35:47 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-29 07:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:48 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 6336 | hits on page: 40
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for JL91815: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: US61717
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for XP10598: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for FM49388: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for HT48359: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for RZ86023: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-29 07:35:48 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-29 07:35:48 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-29 07:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:49 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 6336 | hits on page: 40
2026-03-29 07:35:49 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for LH51780: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for UX47002: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for XP96351: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for TM66386: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for MV92547: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for WL10604: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for YP37345: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for PX47030: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for KW72669: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for SZ10404: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for MP44977: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for AR33954: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-29 07:35:50 [auto1.de] INFO: Scrape type for CE68759: 0
2026-03-29 07:35:50 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-29 07:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:52 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 6337 | hits on page: 40
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for LJ68235: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for AW26108: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for EC74122: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for EJ12041: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for WM50806: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for WV19329: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for VR66334: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for WW55400: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for AX24898: 0
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-29 07:35:52 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Scrape type for GD44773: 2
2026-03-29 07:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-29 07:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76b4810-de70-517a-a5a9-5bf0cda02c8d with scrape type 2
2026-03-29 07:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a76b4810-de70-517a-a5a9-5bf0cda02c8d with scrape type 2
2026-03-29 07:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a76b4810-de70-517a-a5a9-5bf0cda02c8d, identifier: GD44773
2026-03-29 07:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-29 07:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773
2026-03-29 07:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a76b4810-de70-517a-a5a9-5bf0cda02c8d with identifier: GD44773 to the API
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:27:35Z',
'fuel_type': 'petrol',
'id': 'a76b4810-de70-517a-a5a9-5bf0cda02c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD44773',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 180414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-31',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 Goal',
'transmission': 'manual',
'trim': 'Goal',
'year': 2006}
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-29 07:35:52 [auto1.de] INFO: Saving data for GD44773: {'auction_closing_time': 1774884455.0, 'created_time': 1773227004.528933, 'last_price_update_time': 1774769752.9801}
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD44773') HTTP/1.1" 204 0
2026-03-29 07:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-29 07:35:53 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-29 07:35:53 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-29 07:35:53 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-29 07:35:53 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-29 07:35:53 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-29 07:35:53 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-29 07:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:54 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 6337 | hits on page: 40
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for FA59135: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for YE81869: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for JG82377: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for GJ77265: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for BY18365: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for FX80624: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for GX75432: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for GM45973: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for EJ52813: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for BX52940: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for SX52884: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for RV05301: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for BL02906: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for WW79477: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for MU06358: 0
2026-03-29 07:35:54 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Scrape type for GE87881: 2
2026-03-29 07:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-29 07:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d829f77c-2554-5c6d-a935-664f70684e7d with scrape type 2
2026-03-29 07:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d829f77c-2554-5c6d-a935-664f70684e7d with scrape type 2
2026-03-29 07:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d829f77c-2554-5c6d-a935-664f70684e7d, identifier: GE87881
2026-03-29 07:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-29 07:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881
2026-03-29 07:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d829f77c-2554-5c6d-a935-664f70684e7d with identifier: GE87881 to the API
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:33:37Z',
'fuel_type': 'diesel',
'id': 'd829f77c-2554-5c6d-a935-664f70684e7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE87881',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Transporter',
'odometer': 96990,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-21',
'seller_name': None,
'title': 'Volkswagen T5 Transporter 1.9 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2008}
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-29 07:35:54 [auto1.de] INFO: Saving data for GE87881: {'auction_closing_time': 1774884817.0, 'created_time': 1774552899.19547, 'last_price_update_time': 1774769754.962633}
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE87881') HTTP/1.1" 204 0
2026-03-29 07:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:55 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-29 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-29 07:35:55 [auto1.de] INFO: Scrape type for ZY60733: 0
2026-03-29 07:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:57 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 6337 | hits on page: 40
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for GH74073: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for VW88901: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for DK10933: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for ZY38898: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for UW42720: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for CA65369: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: US56502
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for SD28198: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for MX86281: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for HW30650: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-29 07:35:57 [auto1.de] INFO: Scrape type for GJ36407: 0
2026-03-29 07:35:57 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-29 07:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:58 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 6337 | hits on page: 40
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for ME64315: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for WX41369: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for DK89074: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for MN48285: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for FF62684: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for PP24406: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for MZ72093: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for TB77095: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for YB40017: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for HL71363: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for FZ89308: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: US92808
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for US92808: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-29 07:35:58 [auto1.de] INFO: Scrape type for SG17640: 0
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-29 07:35:58 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-29 07:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:35:59 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 6337 | hits on page: 40
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for WW27642: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-29 07:35:59 [auto1.de] INFO: Scrape type for JG45711: 0
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-29 07:35:59 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-29 07:36:00 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-29 07:36:00 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-29 07:36:00 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-29 07:36:00 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-29 07:36:00 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-29 07:36:00 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-29 07:36:00 [auto1.de] INFO: Scrape type for PC42452: 0
2026-03-29 07:36:00 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-29 07:36:00 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-29 07:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:06 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 23 pages/min), scraped 224 items (at 5 items/min)
2026-03-29 07:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 07:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:17 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for PC42452: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for ER69054: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for WB38942: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for XS50752: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for LR98326: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-29 07:36:17 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-29 07:36:17 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-29 07:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:18 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-29 07:36:18 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-29 07:36:18 [auto1.de] INFO: Scrape type for DW90276: 0
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-29 07:36:18 [auto1.de] INFO: Scrape type for UA17642: 0
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-29 07:36:18 [auto1.de] INFO: Scrape type for YM57013: 0
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-29 07:36:18 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-29 07:36:18 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-29 07:36:18 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-29 07:36:18 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-29 07:36:18 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for XY70185: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for LP67164: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for ZF64276: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for VH67229: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for MF45027: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-29 07:36:19 [auto1.de] INFO: Scrape type for NV13181: 0
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-29 07:36:19 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-29 07:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:20 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for NF91917: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for WS69855: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for TB49418: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for TW80485: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for JD76793: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for ZV64166: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for EP38579: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for ZJ64916: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for HP00850: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-29 07:36:20 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-29 07:36:20 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-29 07:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:21 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for TW44839: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for HX15626: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for RL20580: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for AX39550: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for CG53828: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for RF33157: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for JT67031: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for MA51695: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for VL78522: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for TH91647: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for PC91683: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for XG51341: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for BS00370: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-29 07:36:21 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-29 07:36:21 [auto1.de] INFO: Scrape type for HD47083: 0
2026-03-29 07:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:22 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-29 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-29 07:36:22 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-29 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-29 07:36:22 [auto1.de] INFO: Scrape type for CT53994: 0
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-29 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-29 07:36:22 [auto1.de] INFO: Scrape type for MA63217: 0
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-29 07:36:22 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-29 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for DE59201: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for XK18770: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for XP95900: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for ND25281: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for SD67792: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for LE21956: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for SC73852: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-29 07:36:23 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-29 07:36:23 [auto1.de] INFO: Scrape type for SX98211: 0
2026-03-29 07:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:24 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:24 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-29 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-29 07:36:24 [auto1.de] INFO: Scrape type for YU55800: 0
2026-03-29 07:36:24 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-29 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-29 07:36:24 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-29 07:36:24 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-29 07:36:24 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-29 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-29 07:36:24 [auto1.de] INFO: Scrape type for PV56207: 0
2026-03-29 07:36:24 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for DW00961: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for MJ13308: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for BD43064: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for YB62347: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for VS70073: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for AW92068: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for WP04220: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for UX30716: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for ZJ20078: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for WB37074: 0
2026-03-29 07:36:25 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-29 07:36:25 [auto1.de] INFO: Scrape type for JF95451: 0
2026-03-29 07:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:26 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for LK66468: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for TK27520: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for ZS04919: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for JR60766: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for YV09971: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for PW95662: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for KF40481: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for EG14085: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-29 07:36:26 [auto1.de] INFO: Scrape type for XP52765: 0
2026-03-29 07:36:26 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-29 07:36:27 [auto1.de] INFO: Scrape type for UM78498: 0
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-29 07:36:27 [auto1.de] INFO: Scrape type for WM97258: 0
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-29 07:36:27 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-29 07:36:27 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-29 07:36:27 [auto1.de] INFO: Scrape type for NM34350: 0
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-29 07:36:27 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-29 07:36:27 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-29 07:36:27 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-29 07:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:28 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for YT60499: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for ZU85888: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for DK81412: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for SK08799: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for GT57416: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for JR87294: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for XV15906: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for FV46397: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for RB77182: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for HA44433: 0
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-29 07:36:28 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-29 07:36:28 [auto1.de] INFO: Scrape type for CC89371: 0
2026-03-29 07:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:29 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for BX01003: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for LK17231: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for PB00515: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for EX67189: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for LL09257: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for SC92751: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for KS94316: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for ML83071: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for YL63918: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for XR15758: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: US86443
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for HV40211: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for ZG52180: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for JY24308: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for RJ15430: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for VJ26450: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for UD91634: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for DN11419: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for WC38783: 0
2026-03-29 07:36:29 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-29 07:36:29 [auto1.de] INFO: Scrape type for UL11229: 0
2026-03-29 07:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:30 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for NA89904: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for HF93741: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for KB62018: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for UC48235: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for GV24790: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for UE28952: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-29 07:36:30 [auto1.de] INFO: Scrape type for JN13946: 0
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-29 07:36:30 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-29 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for AE12757: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for GA58010: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for PZ27483: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for DJ97721: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for XD68871: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for VE41412: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for FH31570: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-29 07:36:31 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-29 07:36:31 [auto1.de] INFO: Scrape type for SV69616: 0
2026-03-29 07:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:32 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for VB56822: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for EB81332: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for HM11779: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for CU93791: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for SG31546: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for NZ68458: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for CU11315: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for CD13649: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for BP82527: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for FX32627: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for XM89515: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for BX10295: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-29 07:36:32 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-29 07:36:32 [auto1.de] INFO: Scrape type for YM11561: 0
2026-03-29 07:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:33 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for RR41525: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for XB63753: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-29 07:36:33 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-29 07:36:33 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-29 07:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:34 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-29 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-29 07:36:34 [auto1.de] INFO: Scrape type for ZE10872: 0
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-29 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-29 07:36:34 [auto1.de] INFO: Scrape type for TN09859: 0
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-29 07:36:34 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-29 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for FZ40219: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for JS15071: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for SN98432: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for XT08525: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for GL59385: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for FL14438: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for AP13896: 0
2026-03-29 07:36:35 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-29 07:36:35 [auto1.de] INFO: Scrape type for HX75388: 0
2026-03-29 07:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:36 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 6340 | hits on page: 40
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for LU16486: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for TV60687: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for CA50565: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for GE73392: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-29 07:36:36 [auto1.de] INFO: Scrape type for LX68947: 0
2026-03-29 07:36:36 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-29 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-29 07:36:37 [auto1.de] INFO: Scrape type for ZW26780: 0
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-29 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-29 07:36:37 [auto1.de] INFO: Scrape type for VX06464: 0
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-29 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-29 07:36:37 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-29 07:36:37 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-29 07:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:38 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 6341 | hits on page: 40
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for KA69017: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for KR60146: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for JH22526: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for AT56964: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for LG62730: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for XS50717: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for TK47054: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for LM30127: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-29 07:36:38 [auto1.de] INFO: Scrape type for PE74408: 0
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-29 07:36:38 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-29 07:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:39 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 6341 | hits on page: 40
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for RW09760: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for VX15000: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for CC75051: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for EH74831: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for BN99160: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for ZK28238: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for NM28513: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for YM60509: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for HA69467: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for EA13561: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-29 07:36:39 [auto1.de] INFO: Scrape type for XK59182: 0
2026-03-29 07:36:39 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-29 07:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:41 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 6342 | hits on page: 40
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for SG91001: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for DX61886: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for MR38870: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for ZN01973: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for YS21206: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for LD79531: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for LD63966: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for PT52067: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for MH24339: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for TV17454: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-29 07:36:41 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-29 07:36:41 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-29 07:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:42 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 6342 | hits on page: 40
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for AB49272: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for NG37948: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for WP81367: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for RC84625: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for VF40931: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for PB99961: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for HD35365: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for GC05156: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for HS66521: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for YT67181: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-29 07:36:42 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-29 07:36:42 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-29 07:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:43 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 6342 | hits on page: 40
2026-03-29 07:36:43 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-29 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for GM00936: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for RW93776: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for EK21596: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for TL42173: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for EC36203: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for PU13127: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for DF28851: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-29 07:36:44 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-29 07:36:44 [auto1.de] INFO: Scrape type for HL77146: 0
2026-03-29 07:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:45 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 6342 | hits on page: 40
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for XR58128: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for ST45837: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for JU26227: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for MU44330: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for GV67460: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for NH48980: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for UZ14919: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for KC56991: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for SP37211: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for ZJ20785: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for HJ15324: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for NL79635: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-29 07:36:45 [auto1.de] INFO: Scrape type for DP76469: 0
2026-03-29 07:36:45 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-29 07:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:46 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 6342 | hits on page: 40
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for LU20114: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for MA38279: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for PZ30496: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for CH12661: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for HC35889: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for ZM69821: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for KF80964: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for KR40526: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for NS83554: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for UV09635: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for LR83897: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for EX09851: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for RT47788: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for NF65308: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for RB21288: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for TL00985: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for SM64754: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for PL66942: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for RU39212: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-29 07:36:46 [auto1.de] INFO: Scrape type for ZS99681: 0
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-29 07:36:46 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-29 07:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:48 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 6342 | hits on page: 40
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for EE75447: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for RP15985: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for SP96955: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for GS31332: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: AM12815
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for TH39634: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for MY94359: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for ZS85048: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for ZY92659: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for DK37949: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for RF12873: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for XR35811: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for NC71734: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for JN07474: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for XZ21442: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for YE73742: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for CA87699: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for XU33519: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for NK26673: 0
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-29 07:36:48 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-29 07:36:48 [auto1.de] INFO: Scrape type for NM76791: 0
2026-03-29 07:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:49 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 6342 | hits on page: 40
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: AU44008
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU44008%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for AU44008: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for UN89180: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for YH18669: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for KD63113: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for FL46038: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for NX82618: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for ZD28041: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for LK56613: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for KV17598: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-29 07:36:49 [auto1.de] INFO: Scrape type for HX78633: 0
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-29 07:36:49 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for GY83312: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for BG42804: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for HG43188: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for CW85183: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for KV68719: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: JP17422
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP17422%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for JP17422: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for GJ18953: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for GR83992: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for BV89454: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for MX21840: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for DR45963: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-29 07:36:50 [auto1.de] INFO: Scrape type for RW68722: 0
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-29 07:36:50 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-29 07:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:51 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 6342 | hits on page: 40
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for JX30830: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for EC85375: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for VX97978: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for ED69500: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for AN99140: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for FD40697: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for UK28270: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for UG29438: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for NY30954: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for NZ79152: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for HH84481: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for KA54911: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for TV53465: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for UP69379: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for TP61394: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for BU21003: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for CG91765: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for NG66001: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for EA38947: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for HZ69536: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-29 07:36:51 [auto1.de] INFO: Scrape type for TK93923: 0
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-29 07:36:51 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-29 07:36:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:52 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 6343 | hits on page: 40
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for CS73315: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for SE41978: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for NS35557: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for LW95470: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for GY54695: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for TV85934: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for YN15081: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for PR24120: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for WB47522: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for JL46304: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-29 07:36:52 [auto1.de] INFO: Scrape type for LL96634: 0
2026-03-29 07:36:52 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-29 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for HV52023: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for YT21216: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for EH91304: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for RR27166: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for SJ72548: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for SY42721: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for RM21545: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for UC78524: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for WG52031: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for RY75144: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-29 07:36:53 [auto1.de] INFO: Scrape type for BX11542: 0
2026-03-29 07:36:53 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-29 07:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:36:54 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 6343 | hits on page: 40
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for DN27813: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for HZ35402: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for WA51516: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for GA49917: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for CC10989: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for MP53713: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for YA63127: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for WK48382: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for AN23805: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for VL97674: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for UT78656: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for RT81127: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for KK21790: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for TV45930: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for DZ20117: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for BR60141: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for YA36470: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for VR29597: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for LT01381: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for ZX19467: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for BC54503: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for YR75150: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for TP97389: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for EC10607: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-29 07:36:54 [auto1.de] INFO: Scrape type for LE99206: 0
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-29 07:36:54 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-29 07:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:06 [scrapy.extensions.logstats] INFO: Crawled 145 pages (at 26 pages/min), scraped 224 items (at 0 items/min)
2026-03-29 07:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 07:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:26 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for EC10607: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for LE99206: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for PH13735: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for CY46145: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for NC58057: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for TF03370: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for FF37262: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for UL28707: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for FR17679: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for XG50299: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for VR85555: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for VB32886: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for DC55349: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for HM04559: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for CE21106: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for BN42758: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for ZH67756: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for PN96283: 0
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-29 07:37:26 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-29 07:37:26 [auto1.de] INFO: Scrape type for KZ38664: 0
2026-03-29 07:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:27 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for MF03624: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for EK32140: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: GE75594
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE75594%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for GE75594: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for BH61935: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for CV13370: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for GF54025: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for KK05104: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for DT00553: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for GM93554: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for KC33777: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for JD18961: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for EU91257: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: XK86012
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK86012%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for XK86012: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for MJ24427: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for TY73105: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for ZC07667: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for RY65257: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for AN00284: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for PW75443: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for XZ09557: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for ZU51849: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for VS08295: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for DZ10370: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for LH85097: 0
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-29 07:37:27 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM06899%27 HTTP/1.1" 200 None
2026-03-29 07:37:27 [auto1.de] INFO: Scrape type for ZM06899: 0
2026-03-29 07:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:28 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for MW28967: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for ZB32219: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for HL71303: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for HP58071: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for DZ90314: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for ZD05213: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for WC53392: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for JZ33625: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-29 07:37:28 [auto1.de] INFO: Scrape type for SS01468: 0
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-29 07:37:28 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-29 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-29 07:37:29 [auto1.de] INFO: Scrape type for VU61436: 0
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-29 07:37:29 [auto1.de] INFO: Scrape type for YD79813: 0
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-29 07:37:29 [auto1.de] INFO: Scrape type for JR23306: 0
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-29 07:37:29 [auto1.de] INFO: Scrape type for YN71631: 0
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-29 07:37:29 [auto1.de] INFO: Scrape type for EM86154: 0
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-29 07:37:29 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-29 07:37:29 [auto1.de] INFO: Scrape type for SK06184: 0
2026-03-29 07:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:30 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for SZ07968: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for RT44513: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for JB74543: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for HX73394: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for ES38254: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for PU69799: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for BM68891: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for AN35443: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for CP64572: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for CA31284: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for JE64211: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for RU51924: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for UM98970: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for PP81333: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for RS29828: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for WB65429: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for BV82977: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for ZV11386: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for FW24707: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for NE29415: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for LF31183: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for RU06209: 0
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-29 07:37:30 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-29 07:37:30 [auto1.de] INFO: Scrape type for CN30644: 0
2026-03-29 07:37:31 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-29 07:37:31 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-29 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-29 07:37:31 [auto1.de] INFO: Scrape type for PC42361: 0
2026-03-29 07:37:31 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-29 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-29 07:37:31 [auto1.de] INFO: Scrape type for ZD03679: 0
2026-03-29 07:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:32 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for AJ68338: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for XY91311: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for UJ32060: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for VX51529: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for ZX35580: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for MB10012: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for JB16135: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for WX88880: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for AL99999: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for LD20816: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for FR59515: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-29 07:37:32 [auto1.de] INFO: Scrape type for PB68045: 0
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-29 07:37:32 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-29 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for FK87134: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for AC64408: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for MS92853: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for KJ96076: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: US66744
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for US66744: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for GB90564: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for RL85498: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for NV50024: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for WB83413: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-29 07:37:33 [auto1.de] INFO: Scrape type for NX27502: 0
2026-03-29 07:37:33 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-29 07:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:34 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for MF21991: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for XR92513: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for GZ82101: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for FT59815: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for TN55271: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for ZA78506: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for XT20747: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for GF23268: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for YD01023: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for GJ73585: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for YC95910: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for HE47734: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for JR52179: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for LD23223: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for LM31898: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for HL01555: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for WJ67055: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for EJ09183: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for GZ17275: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for GY04691: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: JD07645
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for WD20973: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for RN07993: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for EC99072: 0
2026-03-29 07:37:34 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-29 07:37:34 [auto1.de] INFO: Scrape type for EN09392: 0
2026-03-29 07:37:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:35 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for DT06996: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for DK35136: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for WJ60429: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for RX22328: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for FG48361: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for VE13678: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for WM91088: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for CG06120: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for XX47236: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for AY24824: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for JR48888: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for WX17645: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for FP27721: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for KC60426: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for EL78604: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for KP52427: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-29 07:37:35 [auto1.de] INFO: Scrape type for UZ60031: 0
2026-03-29 07:37:35 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-29 07:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:36 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for YP26052: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for UX04638: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for XT42092: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for ER27214: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for DU68074: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for ZN38550: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for TR40985: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for BW25069: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-29 07:37:36 [auto1.de] INFO: Scrape type for UH14714: 0
2026-03-29 07:37:36 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-29 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for WR70011: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for UP55636: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for ZT83144: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for UY91981: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for VR01975: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for HL66974: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for CJ73141: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for LT88740: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-29 07:37:37 [auto1.de] INFO: Scrape type for FE36611: 0
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-29 07:37:37 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-29 07:37:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:38 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for ST78057: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for PV80087: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for KY32435: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for PY07739: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for DN86096: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for RV77607: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for UP26126: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for TV59519: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for AC34212: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for EW67018: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for AL30364: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for FW19107: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for SJ02125: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for VL24807: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for NF97550: 0
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-29 07:37:38 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-29 07:37:38 [auto1.de] INFO: Scrape type for ZA82087: 0
2026-03-29 07:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:39 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:39 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for PR51827: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for KU26816: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for CM42106: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for UR14680: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for GZ33681: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for XT67395: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for XT85364: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for KJ39198: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for EX55373: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for BN44220: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for KT60539: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for JM65569: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for LX23482: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for KC29293: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for HM10485: 0
2026-03-29 07:37:40 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-29 07:37:40 [auto1.de] INFO: Scrape type for GZ74020: 0
2026-03-29 07:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:41 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for HZ02763: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for KZ16493: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for DF05561: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for GK39429: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for MV07839: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for AW19440: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for DG41556: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for HU15676: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for SV56483: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for ZM61762: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for LJ25581: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for LL75700: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for NG57043: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for XA48872: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for ZZ30319: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for FJ78997: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for SC04632: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for CA87929: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for GL40281: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for WC65602: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for HF13996: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-29 07:37:41 [auto1.de] INFO: Scrape type for RX58241: 0
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-29 07:37:41 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-29 07:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:42 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for VN03026: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for NS77188: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for GT32005: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for SF89930: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for FF09080: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for XU36975: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for NF23902: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for TR04886: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for JR73784: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for TK15682: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for DT59270: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for SD29600: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for AY51976: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for KT35256: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-29 07:37:42 [auto1.de] INFO: Scrape type for ZY39038: 0
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-29 07:37:42 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-29 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-29 07:37:43 [auto1.de] INFO: Scrape type for EA52308: 0
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-29 07:37:43 [auto1.de] INFO: Scrape type for KD45426: 0
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-29 07:37:43 [auto1.de] INFO: Scrape type for VZ43833: 0
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-29 07:37:43 [auto1.de] INFO: Scrape type for HA56884: 0
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-29 07:37:43 [auto1.de] INFO: Scrape type for FD80393: 0
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-29 07:37:43 [auto1.de] INFO: Scrape type for XB41121: 0
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-29 07:37:43 [auto1.de] INFO: Scrape type for DA22909: 0
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-29 07:37:43 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-29 07:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:44 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for BF10429: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for XY13632: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for MH64159: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for CU51280: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for TS47391: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for JD30879: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for ZF87196: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for DK10749: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for DD00982: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for JV93942: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for RR37288: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for XL20163: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for RW03523: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for ZY17523: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for GW53776: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for PH41345: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for FB79072: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-29 07:37:44 [auto1.de] INFO: Scrape type for KW07987: 0
2026-03-29 07:37:44 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-29 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-29 07:37:45 [auto1.de] INFO: Scrape type for HC06893: 0
2026-03-29 07:37:45 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-29 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-29 07:37:45 [auto1.de] INFO: Scrape type for BM85402: 0
2026-03-29 07:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:46 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for CA67550: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for ZG02351: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for UK87241: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for PJ27517: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for MN00804: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for GH25955: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for AF81396: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for FJ89028: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for GY71036: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for HB96226: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for GS36349: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for HA50795: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for UZ55149: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for NC03535: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for HR22131: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for YM01256: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for AD09354: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for YD36788: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for EY64053: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for NK14391: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for HA88960: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for CV20886: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for BF20079: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for YH86831: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for GU24004: 0
2026-03-29 07:37:46 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-29 07:37:46 [auto1.de] INFO: Scrape type for KR12848: 0
2026-03-29 07:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:47 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for RR83304: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for UE39516: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for GM93366: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for VV13794: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for YZ93314: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for ZE64138: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for FH72870: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for RV36249: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for GR32471: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for TJ69669: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for CX33153: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for XL82798: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for DE88009: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for HF51839: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for EC79074: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-29 07:37:47 [auto1.de] INFO: Scrape type for KE20907: 0
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-29 07:37:47 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-29 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-29 07:37:48 [auto1.de] INFO: Scrape type for ZM57049: 0
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-29 07:37:48 [auto1.de] INFO: Scrape type for KW41122: 0
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-29 07:37:48 [auto1.de] INFO: Scrape type for EU16330: 0
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-29 07:37:48 [auto1.de] INFO: Scrape type for DR88922: 0
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-29 07:37:48 [auto1.de] INFO: Scrape type for SL55745: 0
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-29 07:37:48 [auto1.de] INFO: Scrape type for WA61115: 0
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-29 07:37:48 [auto1.de] INFO: Scrape type for SJ49235: 0
2026-03-29 07:37:48 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-29 07:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:49 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for BT33018: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for KT95165: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for JX65004: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for VG77732: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for MW16405: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for BY24352: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for SV90594: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for CN43056: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for RA08562: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for MZ03639: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for EL77757: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for BS45971: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for NT95392: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for FB20065: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-29 07:37:49 [auto1.de] INFO: Scrape type for YV73995: 0
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-29 07:37:49 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-29 07:37:50 [auto1.de] INFO: Scrape type for JX55294: 0
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-29 07:37:50 [auto1.de] INFO: Scrape type for BK93979: 0
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-29 07:37:50 [auto1.de] INFO: Scrape type for LC65511: 0
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-29 07:37:50 [auto1.de] INFO: Scrape type for NH74164: 0
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-29 07:37:50 [auto1.de] INFO: Scrape type for CG50140: 0
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-29 07:37:50 [auto1.de] INFO: Scrape type for YL16347: 0
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-29 07:37:50 [auto1.de] INFO: Scrape type for MN41763: 0
2026-03-29 07:37:50 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-29 07:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:51 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 6347 | hits on page: 40
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for SY55071: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for WT57840: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for BZ34179: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for GZ42240: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for DZ63249: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for MN76950: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for KV46000: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for TA12646: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for VG58612: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for LB45550: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for YC71395: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for SW39146: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for SS56268: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for HM38388: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for SA98041: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for HS55924: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for RM27503: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for GB23451: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for GD85387: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for NW01608: 0
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-29 07:37:51 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-29 07:37:51 [auto1.de] INFO: Scrape type for TY06085: 0
2026-03-29 07:37:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:52 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 6348 | hits on page: 40
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for TY06085: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for NU23342: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for FL62048: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for MG84960: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for KU56806: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for YB04799: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for ME28341: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for AU10222: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for MN75028: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for SB90605: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for HL93382: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for HU71027: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for HW93754: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for NB68023: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for BG93361: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for ZV32018: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for FT64289: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for KE10146: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-29 07:37:52 [auto1.de] INFO: Scrape type for PN64243: 0
2026-03-29 07:37:52 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-29 07:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:53 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 6348 | hits on page: 40
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-29 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-29 07:37:53 [auto1.de] INFO: Scrape type for WH57282: 0
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-29 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-29 07:37:53 [auto1.de] INFO: Scrape type for SE82228: 0
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-29 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-29 07:37:53 [auto1.de] INFO: Scrape type for ZY49257: 0
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-29 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-29 07:37:53 [auto1.de] INFO: Scrape type for PG18082: 0
2026-03-29 07:37:53 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-29 07:37:54 [auto1.de] INFO: Scrape type for VX47645: 0
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-29 07:37:54 [auto1.de] INFO: Scrape type for BV18863: 0
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-29 07:37:54 [auto1.de] INFO: Scrape type for HE38410: 0
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-29 07:37:54 [auto1.de] INFO: Scrape type for YC00182: 0
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-29 07:37:54 [auto1.de] INFO: Scrape type for KZ11771: 0
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-29 07:37:54 [auto1.de] INFO: Scrape type for HJ16589: 0
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-29 07:37:54 [auto1.de] INFO: Scrape type for KM53361: 0
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-29 07:37:54 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-29 07:37:54 [auto1.de] INFO: Scrape type for PU74458: 0
2026-03-29 07:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:55 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 6348 | hits on page: 40
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for NK23311: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for HP69948: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19312%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for YJ19312: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for NE48651: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for BA78869: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for DJ78015: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for SM71650: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for ZU52934: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for PW89679: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for GD61279: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for KU32415: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for NG84191: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for UX99567: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for SR86923: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for ZX68256: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for CZ39134: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for EU15499: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for HG48100: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for WA68058: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for RZ05971: 0
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-29 07:37:55 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-29 07:37:55 [auto1.de] INFO: Scrape type for VL73605: 0
2026-03-29 07:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:37:57 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 6348 | hits on page: 40
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for TZ58013: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for MG73872: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for RM35826: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for EH57829: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for GR42785: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for MM73538: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for AH24505: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for RF00811: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for CA70430: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for AZ56926: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for GY33643: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for EK48004: 0
2026-03-29 07:37:57 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-29 07:37:57 [auto1.de] INFO: Scrape type for WJ88731: 2
2026-03-29 07:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-29 07:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e7d92d-40dc-520a-bd63-40bdfa513f52 with scrape type 2
2026-03-29 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e7d92d-40dc-520a-bd63-40bdfa513f52 with scrape type 2
2026-03-29 07:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e7d92d-40dc-520a-bd63-40bdfa513f52, identifier: WJ88731
2026-03-29 07:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-29 07:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-29 07:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731 to the API
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:32:02Z',
'fuel_type': 'diesel',
'id': '57e7d92d-40dc-520a-bd63-40bdfa513f52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ88731',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 224746,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-20',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDIe Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2010}
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-29 07:37:58 [auto1.de] INFO: Saving data for WJ88731: {'auction_closing_time': 1774884722.0, 'created_time': 1774349360.183378, 'last_price_update_time': 1774769878.181626}
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ88731') HTTP/1.1" 204 0
2026-03-29 07:37:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:37:58 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-29 07:37:58 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-29 07:37:58 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-29 07:37:58 [auto1.de] INFO: Scrape type for WA60872: 2
2026-03-29 07:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-29 07:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with scrape type 2
2026-03-29 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with scrape type 2
2026-03-29 07:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a7e9528-bd23-5cf0-84bc-d15e226d5405, identifier: WA60872
2026-03-29 07:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-29 07:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-29 07:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872 to the API
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:38:10Z',
'fuel_type': 'petrol',
'id': '1a7e9528-bd23-5cf0-84bc-d15e226d5405',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA60872',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 112988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-08',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-29 07:37:58 [auto1.de] INFO: Saving data for WA60872: {'auction_closing_time': 1774885090.0, 'created_time': 1773467701.248596, 'last_price_update_time': 1774769878.690565}
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA60872') HTTP/1.1" 204 0
2026-03-29 07:37:58 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-29 07:37:58 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-29 07:37:58 [auto1.de] INFO: Scrape type for RJ17594: 2
2026-03-29 07:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-29 07:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e839da47-a265-5073-a3c9-e1f3fcc66791 with scrape type 2
2026-03-29 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e839da47-a265-5073-a3c9-e1f3fcc66791 with scrape type 2
2026-03-29 07:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e839da47-a265-5073-a3c9-e1f3fcc66791, identifier: RJ17594
2026-03-29 07:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-29 07:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-29 07:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594 to the API
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:41:15Z',
'fuel_type': 'petrol',
'id': 'e839da47-a265-5073-a3c9-e1f3fcc66791',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ17594',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 134468,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-21',
'seller_name': None,
'title': 'BMW 3er 325i',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-29 07:37:59 [auto1.de] INFO: Saving data for RJ17594: {'auction_closing_time': 1774885275.0, 'created_time': 1774032970.814148, 'last_price_update_time': 1774769879.086487}
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ17594') HTTP/1.1" 204 0
2026-03-29 07:37:59 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-29 07:37:59 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-29 07:37:59 [auto1.de] INFO: Scrape type for WC98530: 2
2026-03-29 07:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-29 07:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c67fdd3d-1904-5dd2-9b74-02e70968d0cd with scrape type 2
2026-03-29 07:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c67fdd3d-1904-5dd2-9b74-02e70968d0cd with scrape type 2
2026-03-29 07:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c67fdd3d-1904-5dd2-9b74-02e70968d0cd, identifier: WC98530
2026-03-29 07:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-29 07:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-29 07:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530 to the API
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:34:16Z',
'fuel_type': 'petrol',
'id': 'c67fdd3d-1904-5dd2-9b74-02e70968d0cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC98530',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 158677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-13',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 TGDI Style 2WD',
'transmission': 'manual',
'trim': 'Style 2WD',
'year': 2016}
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-29 07:37:59 [auto1.de] INFO: Saving data for WC98530: {'auction_closing_time': 1774884856.0, 'created_time': 1773467740.019583, 'last_price_update_time': 1774769879.493939}
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC98530') HTTP/1.1" 204 0
2026-03-29 07:37:59 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-29 07:37:59 [auto1.de] INFO: Scrape type for ET93890: 2
2026-03-29 07:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-29 07:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b65f4b38-f73c-522e-b3fd-0c404dc63004 with scrape type 2
2026-03-29 07:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b65f4b38-f73c-522e-b3fd-0c404dc63004 with scrape type 2
2026-03-29 07:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b65f4b38-f73c-522e-b3fd-0c404dc63004, identifier: ET93890
2026-03-29 07:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-29 07:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-29 07:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890 to the API
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:48:02Z',
'fuel_type': 'petrol',
'id': 'b65f4b38-f73c-522e-b3fd-0c404dc63004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET93890',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 113804,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-31',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-29 07:37:59 [auto1.de] INFO: Saving data for ET93890: {'auction_closing_time': 1774885682.0, 'created_time': 1774118797.859971, 'last_price_update_time': 1774769879.885947}
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET93890') HTTP/1.1" 204 0
2026-03-29 07:37:59 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-29 07:37:59 [auto1.de] INFO: Scrape type for DV01854: 2
2026-03-29 07:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-29 07:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with scrape type 2
2026-03-29 07:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with scrape type 2
2026-03-29 07:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4, identifier: DV01854
2026-03-29 07:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-29 07:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-29 07:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854 to the API
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:47:44Z',
'fuel_type': 'petrol',
'id': '354d9018-5234-551b-b3e4-d3a6ed7c5ad4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV01854',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 98909,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-28',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2017}
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-29 07:38:00 [auto1.de] INFO: Saving data for DV01854: {'auction_closing_time': 1774885664.0, 'created_time': 1774031526.51608, 'last_price_update_time': 1774769880.294616}
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV01854') HTTP/1.1" 204 0
2026-03-29 07:38:00 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-29 07:38:00 [auto1.de] INFO: Scrape type for UE23148: 2
2026-03-29 07:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-29 07:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f7b76f-04a9-586f-8ca0-47c78321bc64 with scrape type 2
2026-03-29 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94f7b76f-04a9-586f-8ca0-47c78321bc64 with scrape type 2
2026-03-29 07:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94f7b76f-04a9-586f-8ca0-47c78321bc64, identifier: UE23148
2026-03-29 07:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 07:38:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-29 07:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148 to the API
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'petrol',
'id': '94f7b76f-04a9-586f-8ca0-47c78321bc64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE23148',
'listing': 'auction',
'make': 'Seat',
'model': 'Mii',
'odometer': 147585,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-06',
'seller_name': None,
'title': 'Seat Mii 1.0 Reference Viva',
'transmission': 'manual',
'trim': 'Reference Viva',
'year': 2012}
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-29 07:38:00 [auto1.de] INFO: Saving data for UE23148: {'auction_closing_time': 1774884844.0, 'created_time': 1773340610.380669, 'last_price_update_time': 1774769880.812841}
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE23148') HTTP/1.1" 204 0
2026-03-29 07:38:00 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-29 07:38:00 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-29 07:38:00 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-29 07:38:00 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-29 07:38:00 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-29 07:38:00 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-29 07:38:00 [auto1.de] INFO: Scrape type for ZS91776: 2
2026-03-29 07:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-29 07:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 899911fb-c83e-509a-9d54-68363a7de170 with scrape type 2
2026-03-29 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 899911fb-c83e-509a-9d54-68363a7de170 with scrape type 2
2026-03-29 07:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 899911fb-c83e-509a-9d54-68363a7de170, identifier: ZS91776
2026-03-29 07:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-29 07:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-29 07:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776 to the API
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:37:00Z',
'fuel_type': 'petrol',
'id': '899911fb-c83e-509a-9d54-68363a7de170',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS91776',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 94546,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-25',
'seller_name': None,
'title': 'Opel Corsa 1.6 Turbo OPC',
'transmission': 'manual',
'trim': 'OPC',
'year': 2010}
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-29 07:38:01 [auto1.de] INFO: Saving data for ZS91776: {'auction_closing_time': 1774885020.0, 'created_time': 1773467171.650569, 'last_price_update_time': 1774769881.223186}
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS91776') HTTP/1.1" 204 0
2026-03-29 07:38:01 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-29 07:38:01 [auto1.de] INFO: Scrape type for VX64192: 2
2026-03-29 07:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-29 07:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5805ee99-583c-596a-a675-190db41ed1b1 with scrape type 2
2026-03-29 07:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5805ee99-583c-596a-a675-190db41ed1b1 with scrape type 2
2026-03-29 07:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5805ee99-583c-596a-a675-190db41ed1b1, identifier: VX64192
2026-03-29 07:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-29 07:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-29 07:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192 to the API
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:57Z',
'fuel_type': 'diesel',
'id': '5805ee99-583c-596a-a675-190db41ed1b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX64192',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 153076,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-09',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-29 07:38:01 [auto1.de] INFO: Saving data for VX64192: {'auction_closing_time': 1774883997.0, 'created_time': 1774118886.855884, 'last_price_update_time': 1774769881.716209}
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX64192') HTTP/1.1" 204 0
2026-03-29 07:38:01 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-29 07:38:01 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-29 07:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:38:04 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 6349 | hits on page: 29
2026-03-29 07:38:04 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-29 07:38:04 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-29 07:38:04 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-29 07:38:04 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-29 07:38:04 [auto1.de] INFO: Scrape type for ED17592: 2
2026-03-29 07:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-29 07:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac4f785e-414a-5783-bbc9-b6e608012840 with scrape type 2
2026-03-29 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac4f785e-414a-5783-bbc9-b6e608012840 with scrape type 2
2026-03-29 07:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac4f785e-414a-5783-bbc9-b6e608012840, identifier: ED17592
2026-03-29 07:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-29 07:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-29 07:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592 to the API
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:57:51Z',
'fuel_type': 'petrol',
'id': 'ac4f785e-414a-5783-bbc9-b6e608012840',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED17592',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla Verso',
'odometer': 90377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-02-27',
'seller_name': None,
'title': 'Toyota Corolla Verso 1.8 Sol',
'transmission': 'automatic',
'trim': 'Sol',
'year': 2003}
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-29 07:38:04 [auto1.de] INFO: Saving data for ED17592: {'auction_closing_time': 1774886271.0, 'created_time': 1773467238.933615, 'last_price_update_time': 1774769884.68771}
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED17592') HTTP/1.1" 204 0
2026-03-29 07:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:38:04 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-29 07:38:04 [auto1.de] INFO: Scrape type for FX10664: 2
2026-03-29 07:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-29 07:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with scrape type 2
2026-03-29 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with scrape type 2
2026-03-29 07:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1, identifier: FX10664
2026-03-29 07:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-29 07:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-29 07:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664 to the API
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:11:26Z',
'fuel_type': 'diesel',
'id': '8b6aace6-73a2-5f25-abf9-7cd08a6826b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX10664',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 173452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-12',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro Sport selection',
'transmission': 'automatic',
'trim': 'quattro Sport selection',
'year': 2013}
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-29 07:38:05 [auto1.de] INFO: Saving data for FX10664: {'auction_closing_time': 1774883486.0, 'created_time': 1774118554.546192, 'last_price_update_time': 1774769885.100676}
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX10664') HTTP/1.1" 204 0
2026-03-29 07:38:05 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-29 07:38:05 [auto1.de] INFO: Scrape type for YS85041: 2
2026-03-29 07:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-29 07:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc741722-e624-5e40-a631-61295802977a with scrape type 2
2026-03-29 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc741722-e624-5e40-a631-61295802977a with scrape type 2
2026-03-29 07:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc741722-e624-5e40-a631-61295802977a, identifier: YS85041
2026-03-29 07:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-29 07:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-29 07:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041 to the API
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:13:47Z',
'fuel_type': 'petrol',
'id': 'cc741722-e624-5e40-a631-61295802977a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS85041',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 151746,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-29',
'seller_name': None,
'title': 'Renault Twingo 1.2 YAHOO!',
'transmission': 'manual',
'trim': 'YAHOO!',
'year': 2011}
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-29 07:38:05 [auto1.de] INFO: Saving data for YS85041: {'auction_closing_time': 1774883627.0, 'created_time': 1773946040.302004, 'last_price_update_time': 1774769885.858541}
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS85041') HTTP/1.1" 204 0
2026-03-29 07:38:05 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-29 07:38:05 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-29 07:38:05 [auto1.de] INFO: Scrape type for WG54603: 2
2026-03-29 07:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-29 07:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with scrape type 2
2026-03-29 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with scrape type 2
2026-03-29 07:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd, identifier: WG54603
2026-03-29 07:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-29 07:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-29 07:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603 to the API
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:45:45Z',
'fuel_type': 'petrol',
'id': 'd7dd9e17-be31-5b6b-a31a-e85064d8f3dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG54603',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 168513,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-25',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-29 07:38:06 [auto1.de] INFO: Saving data for WG54603: {'auction_closing_time': 1774885545.0, 'created_time': 1773945281.786207, 'last_price_update_time': 1774769886.277095}
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG54603') HTTP/1.1" 204 0
2026-03-29 07:38:06 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-29 07:38:06 [auto1.de] INFO: Scrape type for VV82390: 2
2026-03-29 07:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-29 07:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be466fb-b23f-5722-b01b-1945c2a5ab78 with scrape type 2
2026-03-29 07:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be466fb-b23f-5722-b01b-1945c2a5ab78 with scrape type 2
2026-03-29 07:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7be466fb-b23f-5722-b01b-1945c2a5ab78, identifier: VV82390
2026-03-29 07:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-29 07:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-29 07:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390 to the API
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:25:59Z',
'fuel_type': 'diesel',
'id': '7be466fb-b23f-5722-b01b-1945c2a5ab78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV82390',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 152220,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-13',
'seller_name': None,
'title': 'Audi A4 45 TDI quattro advanced',
'transmission': 'automatic',
'trim': 'quattro advanced',
'year': 2020}
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-29 07:38:06 [auto1.de] INFO: Saving data for VV82390: {'auction_closing_time': 1774884359.0, 'created_time': 1774349641.18222, 'last_price_update_time': 1774769886.805018}
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV82390') HTTP/1.1" 204 0
2026-03-29 07:38:06 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-29 07:38:06 [auto1.de] INFO: Scrape type for SK64465: 0
2026-03-29 07:38:06 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-29 07:38:06 [auto1.de] INFO: Scrape type for GY99851: 2
2026-03-29 07:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-29 07:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee98b40-6325-5042-bb22-26170b1a5d83 with scrape type 2
2026-03-29 07:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ee98b40-6325-5042-bb22-26170b1a5d83 with scrape type 2
2026-03-29 07:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ee98b40-6325-5042-bb22-26170b1a5d83, identifier: GY99851
2026-03-29 07:38:06 [scrapy.extensions.logstats] INFO: Crawled 167 pages (at 22 pages/min), scraped 238 items (at 14 items/min)
2026-03-29 07:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 07:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-29 07:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-29 07:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851 to the API
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:57:33Z',
'fuel_type': 'diesel',
'id': '5ee98b40-6325-5042-bb22-26170b1a5d83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY99851',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 140000,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-06',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2016}
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-29 07:38:07 [auto1.de] INFO: Saving data for GY99851: {'auction_closing_time': 1774886253.0, 'created_time': 1774293714.839555, 'last_price_update_time': 1774769887.254108}
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY99851') HTTP/1.1" 204 0
2026-03-29 07:38:07 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-29 07:38:07 [auto1.de] INFO: Scrape type for KG73349: 2
2026-03-29 07:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-29 07:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with scrape type 2
2026-03-29 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with scrape type 2
2026-03-29 07:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52, identifier: KG73349
2026-03-29 07:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-29 07:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-29 07:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349 to the API
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:31Z',
'fuel_type': 'petrol',
'id': '3f95168f-3d5d-5947-b30a-0c1e9baf6d52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG73349',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 135637,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-24',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2016}
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-29 07:38:07 [auto1.de] INFO: Saving data for KG73349: {'auction_closing_time': 1774883431.0, 'created_time': 1773467475.85263, 'last_price_update_time': 1774769887.65391}
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG73349') HTTP/1.1" 204 0
2026-03-29 07:38:07 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-29 07:38:07 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-29 07:38:07 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-29 07:38:07 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-29 07:38:07 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-29 07:38:07 [auto1.de] INFO: Scrape type for ZZ82496: 2
2026-03-29 07:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-29 07:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bcc120-49d0-5a50-84a7-daa7d1a94547 with scrape type 2
2026-03-29 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8bcc120-49d0-5a50-84a7-daa7d1a94547 with scrape type 2
2026-03-29 07:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bcc120-49d0-5a50-84a7-daa7d1a94547, identifier: ZZ82496
2026-03-29 07:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-29 07:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-29 07:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496 to the API
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 585,
'expiration_date': '2026-03-30T15:09:33Z',
'fuel_type': 'petrol',
'id': 'b8bcc120-49d0-5a50-84a7-daa7d1a94547',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ82496',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 139095,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-18',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 63 AMG S 4Matic',
'transmission': 'automatic',
'trim': 'S 4Matic',
'year': 2016}
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-29 07:38:08 [auto1.de] INFO: Saving data for ZZ82496: {'auction_closing_time': 1774883373.0, 'created_time': 1774034465.270593, 'last_price_update_time': 1774769888.045519}
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ82496') HTTP/1.1" 204 0
2026-03-29 07:38:08 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-29 07:38:08 [auto1.de] INFO: Scrape type for MA81744: 2
2026-03-29 07:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-29 07:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with scrape type 2
2026-03-29 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with scrape type 2
2026-03-29 07:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c, identifier: MA81744
2026-03-29 07:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-29 07:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-29 07:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744 to the API
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:13:26Z',
'fuel_type': 'hybrid',
'id': '9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA81744',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 177312,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-02',
'seller_name': None,
'title': 'Audi A6 55 TFSIe quattro sport',
'transmission': 'automatic',
'trim': 'quattro sport',
'year': 2021}
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-29 07:38:08 [auto1.de] INFO: Saving data for MA81744: {'auction_closing_time': 1774883606.0, 'created_time': 1773775383.337339, 'last_price_update_time': 1774769888.426162}
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA81744') HTTP/1.1" 204 0
2026-03-29 07:38:08 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-29 07:38:08 [auto1.de] INFO: Scrape type for KG50767: 2
2026-03-29 07:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-29 07:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with scrape type 2
2026-03-29 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with scrape type 2
2026-03-29 07:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fba9dcc1-4ef9-5a74-bb65-bee726d73a84, identifier: KG50767
2026-03-29 07:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-29 07:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-29 07:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767 to the API
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:02:15Z',
'fuel_type': 'diesel',
'id': 'fba9dcc1-4ef9-5a74-bb65-bee726d73a84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG50767',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 167652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-29',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2015}
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-29 07:38:08 [auto1.de] INFO: Saving data for KG50767: {'auction_closing_time': 1774882935.0, 'created_time': 1773468255.451886, 'last_price_update_time': 1774769888.832986}
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG50767') HTTP/1.1" 204 0
2026-03-29 07:38:08 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-29 07:38:08 [auto1.de] INFO: Scrape type for AR70360: 2
2026-03-29 07:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-29 07:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with scrape type 2
2026-03-29 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with scrape type 2
2026-03-29 07:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5, identifier: AR70360
2026-03-29 07:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-29 07:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-29 07:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360 to the API
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:03Z',
'fuel_type': 'diesel',
'id': '2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR70360',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 180598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-07',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2011}
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-29 07:38:09 [auto1.de] INFO: Saving data for AR70360: {'auction_closing_time': 1774884243.0, 'created_time': 1774350011.939473, 'last_price_update_time': 1774769889.314486}
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR70360') HTTP/1.1" 204 0
2026-03-29 07:38:09 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-29 07:38:09 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-29 07:38:09 [auto1.de] INFO: Scrape type for XL74124: 2
2026-03-29 07:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-29 07:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404c4fca-c19b-5890-84ee-eb3638987a80 with scrape type 2
2026-03-29 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 404c4fca-c19b-5890-84ee-eb3638987a80 with scrape type 2
2026-03-29 07:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 404c4fca-c19b-5890-84ee-eb3638987a80, identifier: XL74124
2026-03-29 07:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-29 07:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-29 07:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124 to the API
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:16Z',
'fuel_type': 'petrol',
'id': '404c4fca-c19b-5890-84ee-eb3638987a80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL74124',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 49591,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-26',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
'transmission': 'manual',
'trim': 'United',
'year': 2021}
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-29 07:38:09 [auto1.de] INFO: Saving data for XL74124: {'auction_closing_time': 1774882876.0, 'created_time': 1773468768.767412, 'last_price_update_time': 1774769889.711961}
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL74124') HTTP/1.1" 204 0
2026-03-29 07:38:09 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-29 07:38:09 [auto1.de] INFO: Scrape type for WX78972: 2
2026-03-29 07:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-29 07:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b960b74-6842-5897-b927-5fc7a7079f3c with scrape type 2
2026-03-29 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b960b74-6842-5897-b927-5fc7a7079f3c with scrape type 2
2026-03-29 07:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b960b74-6842-5897-b927-5fc7a7079f3c, identifier: WX78972
2026-03-29 07:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-29 07:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-29 07:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972 to the API
2026-03-29 07:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:23:58Z',
'fuel_type': 'diesel',
'id': '9b960b74-6842-5897-b927-5fc7a7079f3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX78972',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 127572,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-23',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2010}
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-29 07:38:10 [auto1.de] INFO: Saving data for WX78972: {'auction_closing_time': 1774884238.0, 'created_time': 1774089113.821685, 'last_price_update_time': 1774769890.108939}
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX78972') HTTP/1.1" 204 0
2026-03-29 07:38:10 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-29 07:38:10 [auto1.de] INFO: Scrape type for TW02363: 2
2026-03-29 07:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-29 07:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0e6415-259d-5316-bfdc-885b264b1bb2 with scrape type 2
2026-03-29 07:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0e6415-259d-5316-bfdc-885b264b1bb2 with scrape type 2
2026-03-29 07:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0e6415-259d-5316-bfdc-885b264b1bb2, identifier: TW02363
2026-03-29 07:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-29 07:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-29 07:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363 to the API
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:26:00Z',
'fuel_type': 'diesel',
'id': '6b0e6415-259d-5316-bfdc-885b264b1bb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW02363',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 180552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-28',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
'transmission': 'manual',
'trim': 'AMG Line',
'year': 2015}
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-29 07:38:10 [auto1.de] INFO: Saving data for TW02363: {'auction_closing_time': 1774884360.0, 'created_time': 1773945603.287468, 'last_price_update_time': 1774769890.503261}
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW02363') HTTP/1.1" 204 0
2026-03-29 07:38:10 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 6350 | hits on page: 0
2026-03-29 07:38:10 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-29 07:38:10 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-29 07:38:10 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-29 07:38:10 [auto1.de] INFO: Scrape type for YV43994: 2
2026-03-29 07:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-29 07:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with scrape type 2
2026-03-29 07:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with scrape type 2
2026-03-29 07:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f, identifier: YV43994
2026-03-29 07:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-29 07:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-29 07:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994 to the API
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:26:44Z',
'fuel_type': 'diesel',
'id': '6ab434dc-a15f-5a3d-9afd-f0ce2e24630f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV43994',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 202915,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-11',
'seller_name': None,
'title': 'BMW 3er 318d Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2016}
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-29 07:38:10 [auto1.de] INFO: Saving data for YV43994: {'auction_closing_time': 1774884404.0, 'created_time': 1773984685.528767, 'last_price_update_time': 1774769890.890139}
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV43994') HTTP/1.1" 204 0
2026-03-29 07:38:10 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-29 07:38:10 [auto1.de] INFO: Scrape type for HY99539: 2
2026-03-29 07:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-29 07:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with scrape type 2
2026-03-29 07:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with scrape type 2
2026-03-29 07:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb, identifier: HY99539
2026-03-29 07:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-29 07:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-29 07:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539 to the API
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:26:15Z',
'fuel_type': 'petrol',
'id': 'f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY99539',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 131051,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-27',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2009}
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-29 07:38:11 [auto1.de] INFO: Saving data for HY99539: {'auction_closing_time': 1774884375.0, 'created_time': 1774380352.806279, 'last_price_update_time': 1774769891.290748}
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY99539') HTTP/1.1" 204 0
2026-03-29 07:38:11 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-29 07:38:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 07:38:11 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-29 07:38:11 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 6, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 4}
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774337891 HTTP/1.1" 200 None
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AC55286') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BE78083') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BR68015') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BU00213') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV35852') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF13358') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX98346') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA35420') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD41691') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DE32943') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DE39518') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EE98346') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EV60549') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FC01690') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ13396') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GD36991') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GG01771') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GH28235') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HH17172') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT05958') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT50820') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ97206') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC49321') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE20051') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE87095') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JG18890') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KA30622') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL52266') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ13882') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MN42771') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MU83144') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PY11088') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE68190') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RV50447') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TS16016') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UR73654') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UW65294') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VD84228') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WU81290') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XX73883') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ86555') HTTP/1.1" 204 0
2026-03-29 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YD49974') HTTP/1.1" 204 0
2026-03-29 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YV90191') HTTP/1.1" 204 0
2026-03-29 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ18369') HTTP/1.1" 204 0
2026-03-29 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA02135') HTTP/1.1" 204 0
2026-03-29 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD41189') HTTP/1.1" 204 0
2026-03-29 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE47556') HTTP/1.1" 204 0
2026-03-29 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF26236') HTTP/1.1" 204 0
2026-03-29 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG88766') HTTP/1.1" 204 0
2026-03-29 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK00160') HTTP/1.1" 204 0
2026-03-29 07:38:12 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (249 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-29T07_30_00.jl
2026-03-29 07:38:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 486811,
'downloader/request_count': 168,
'downloader/request_method_count/GET': 6,
'downloader/request_method_count/POST': 162,
'downloader/response_bytes': 27711207,
'downloader/response_count': 168,
'downloader/response_status_count/200': 168,
'elapsed_time_seconds': 485.394265,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 29, 7, 38, 12, 68087, tzinfo=datetime.timezone.utc),
'item_scraped_count': 249,
'log_count/DEBUG': 8603,
'log_count/INFO': 11824,
'memusage/max': 165629952,
'memusage/startup': 148045824,
'request_depth_max': 163,
'response_received_count': 168,
'scheduler/dequeued': 168,
'scheduler/dequeued/memory': 168,
'scheduler/enqueued': 168,
'scheduler/enqueued/memory': 168,
'scrape_type/batch_skipped': 3201,
'scrape_type/new': 2,
'scrape_type/price_update': 247,
'scrape_type/skipped': 2939,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 168,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.092936573317276,
'scrapy-zyte-api/mean_response_seconds': 2.235067164170601,
'scrapy-zyte-api/processed': 168,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 168,
'scrapy-zyte-api/request_args/experimental.requestCookies': 167,
'scrapy-zyte-api/request_args/experimental.responseCookies': 168,
'scrapy-zyte-api/request_args/httpRequestBody': 162,
'scrapy-zyte-api/request_args/httpRequestMethod': 162,
'scrapy-zyte-api/request_args/httpResponseBody': 168,
'scrapy-zyte-api/request_args/httpResponseHeaders': 168,
'scrapy-zyte-api/request_args/sessionContext': 168,
'scrapy-zyte-api/request_args/url': 168,
'scrapy-zyte-api/status_codes/200': 168,
'scrapy-zyte-api/success': 168,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 6389,
'source/total_available': 6350,
'start_time': datetime.datetime(2026, 3, 29, 7, 30, 6, 673822, tzinfo=datetime.timezone.utc)}
2026-03-29 07:38:12 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 07:38:12 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fae1beacb50>
2026-03-29 07:38:12 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fae1bc57d90>